In T274636#6975013, @jcrespo wrote:

can you please explain how to link them in backups table

Indeed, that is a really good question.

The backup table status has 3 possible explicit states:

• ongoing: The backup has started, but it has not finished yet
• failed: The backup started and finished with an error
• finished: The backup finished with no errors (including tests of completeness)

There are, however, other states that could be inferred from other fields:

• Backups are scheduled at a point in time, if there are no ongoing entries that have been scheduled, it means it is queued to be executed but not started yet
• Metadata is started to be gathered before postprocessing- if there is any metadata, like the total size, you can know it is being postprocessed/pending to be compressed, etc.

The details are not that important for the proposal, as they would be for an initial analysis after the fact- e.g. if we consider we need more explicit states, we can add those to the original tool.

I hope that is clear.

In T279488#6987343, @jcrespo wrote:

I can devote 40 hours/week for GSoC project

I think you are expected to dedicate 25h per week, or 40 hours, but take some days off in between. Please adjust your project outcome based on a total of 178h of work, I think is the guidelines (but please double confirm on the Google Summer of Code website).

I am worried about selection

Both Manuel and I haven't talked about the quality of any submission so far, and more likely only will do after the deadline. I haven't checked or compared your submission to that of anyone else. The submission is entirely judged on what you submit, and not compared to anyone else. There is (probably) only going to be 1 student selected among all submissions, independently of the idea. You should chose the idea that you see more interesting or fitting for your skills, not the one that is more likely to be chosen, because there is not such an idea. We will chose a student, not an idea.

Having said that, if you don't feel comfortable with your idea (for any reason), you can change it- but my advice is to not do it because it is repeated (all ideas are likely to be repeated by the end of the process)- that will make no difference. Focus on improving your proposal to demonstrate you are the best candidate. Last year, the top candidates chose different ideas purely by chance.

These are just answers to your questions, I will try to do a second pass later.

@jcrespo @Marostegui
Hello, what will happen as my and h.krishna's proposal are for same project idea. Is there any other way to resolve conflict ? should i propose for some other project idea ? I am worried about selection.

Hello , @jcrespo @Marostegui
Can you please review my draft proposal?

A web dashboard that tracks the status of ongoing backups (next scheduled run, running, postprocessing, finishing ETA, etc.)

@jcrespo
I evaluted the database but i could not able to find connection between 'backups(DB_ table) > status(table_field_value = ongoing) ' with (next scheduled run, running, postprocessing, finishing ETA, etc.) can you please explain how to link them in backups table ?

your leetcode test cases seem to fail for the following inputs. I don't think it should, these inputs look fine to me
regex check failed for : dump.s3.2022-06-01--21-06-56.gz
regex check failed for : dump.s3.2021-03-19--12-05-32
You'll probably need to recheck your method a bit.

@jcrespo @h.krishna
dump.s3.2022-06-01--21-06-56.gz and dump.s3.2021-03-19--12-05-32 are failed because it is not ending with .tar.gz however, datetime is correct so, my function will return true for datetime validation but regex check failed for not ending with .tar.gz

@jcrespo @h.krishna
for validating time we can use regex and for validating date we can call a function is this correct ? that will be very easy to understand.

In T274636#6953176, @Palak199 wrote:

@jcrespo

The simplest application you can think covering the given proposal is likely to be chosen, as quality will be valued over number of lines of code. 180h of work is not a lot to ship a complex piece of software, given analysis, design and testing will have to be included there.

Thankyou so much on explaining it so well. It cleared me a lot on do's and don'ts of writing proposal. I am supposed to fill this form
https://phabricator.wikimedia.org/maniphest/task/edit/form/1/
right?

In T277754#6952713, @jcrespo wrote:

@h.krishna very good comment, that is the kind of comment why I asked you to create a ticket.

Having a bare minumum regex (e.g. ...\d\d\d\d\-\d\d\-\d\d) + a call to validate the date would be a good option.

message to be printed as I had originally thought

It would be ok to print a DEBUG or at most an INFO one, but not anything above that (the print was too worrying). There is an expectation of having other section files on the same dir.

Let me know if the function is the better idea then i will start implementing it but before that i should have clear idea what should the function contain.

@jcrespo @h.krishna
i would suggest that to make the regex for leap year is more complicated so as you said we should use datetime module to validate. So function that validate datetime is better idea.
or another way is only validate leap year using code but in this case everytime we have to go through regex and code both. So i think better idea is to make function.

@jcrespo i am sorry about that i will be more carefull from the next time. so should i work on this now or hand over to @Sahilgrewalhere ?

In T277754#6947813, @gerritbot wrote:

Change 675010 had a related patch set uploaded (by Sahilgrewalhere; author: Sahilgrewalhere):
[operations/software/wmfbackups@master] Improved filename regex in cli/recover-dump

https://gerrit.wikimedia.org/r/675010

@jcrespo
dump.s3.2022-11-12--19-05-35
dump.s3.2021-03-19--12-05-32

@Sahilgrewalhere i am working on this so, please work on some different task.

@jcrespo i want to work on this good first task.

@jcrespo thank you very much.

@jcrespo
i have added new repository at https://phabricator.wikimedia.org/diffusion/OSWB/ named " web" for frontend/web components. i have just added basic flask webapp which can be further modified as we add frontend/dashboard component. if any further changes required let me know and what should be the next step ? should i start integrating .sql with maria DB and put some basic components ?
for review..
https://gerrit.wikimedia.org/r/c/operations/software/wmfbackups/+/673693

@jcrespo
for now , it is clear. i will let you know if any further changes required. i will try to add new respsitory for frontend/web.

In T274636#6922796, @jcrespo wrote:

In T274636#6919777, @DharmrajRathod98 wrote:

@jcrespo
for Database backup inventory improvements this new project idea flask webapp would be better for me. Should i set up flask with Maria DB 10.4, Apache on my local (ubuntu 20.04 ) machine ? After that for testing i need to clone this (tox testing) operations/software/wmfbackups respository. Am i understood correctly?

For most of this project propoals, there is no existing code- a new repository will be setup so you start from 0. What exists is some related pieces of code or a database -that you can read and get an understanding what are the current usages. For example, for the database backup inventory, there is another repo for reading and writing to the database, and a database schema, but there is no existing code for a dashboard. You should download the .sql file and build the web dashboard around that database schema. I hope that is clear- please ask for further clarifications.

For everybody else: doing a deeper understanding of the requirements will be part of the project time.

@jcrespo
Thank you very much for clearing my queries. i think this much information is enough for me to understand the project idea. that would be great if you can provide link of another repo for reading and writing to the database, i have seen schemas from wiki/MariaDB/Backups#Metadata (if anything else is there please give me a link) and from where can i download .sql file for Database backup inventory improvements this specific project idea.

@jcrespo
for Database backup inventory improvements this new project idea flask webapp would be better for me. Should i set up flask with Maria DB 10.4, Apache on my local (ubuntu 20.04 ) machine ? After that for testing i need to clone this (tox testing) operations/software/wmfbackups respository. Am i understood correctly?

In T274636#6868804, @Aklapper wrote:

@DharmrajRathod98: Welcome and thanks for your interest. Can you please elaborate which specific areas / questions are unclear and require more guidance? Please see https://www.mediawiki.org/wiki/New_Developers - thanks a lot! :)

Hello @jcrespo,
My name is Dharmraj Rathod. I am Currently pursuing Mtech at Indian Institute of Information and Technology Vadodara. I am quite new to open source but I am very excited to learn this things. I found the prerequisites of this project to be matching with my skillset and thus i am interested in contributing to this idea for GSOC-2021. Can you please guide me little bit ? so i can understand code base for this idea and start contributing some small tasks.