Page MenuHomePhabricator

DharmrajRathod98 (rathod98)
User

Projects

User does not belong to any projects.

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Wednesday

  • Clear sailing ahead.

User Details

User Since
Mar 1 2021, 5:22 AM (30 w, 18 h)
Availability
Available
LDAP User
Unknown
MediaWiki User
DharmrajRathod98 [ Global Accounts ]

Recent Activity

Apr 16 2021

DharmrajRathod98 moved T279488: Develop Dashboard with Flask For Database backup inventory improvements from Backlog to Proposals Submitted on the Google-Summer-of-Code (2021) board.
Apr 16 2021, 6:11 AM · dbbackups-dashboard, Google-Summer-of-Code (2021)

Apr 13 2021

DharmrajRathod98 updated the task description for T279488: Develop Dashboard with Flask For Database backup inventory improvements.
Apr 13 2021, 5:55 AM · dbbackups-dashboard, Google-Summer-of-Code (2021)

Apr 12 2021

DharmrajRathod98 updated the task description for T279488: Develop Dashboard with Flask For Database backup inventory improvements.
Apr 12 2021, 11:38 AM · dbbackups-dashboard, Google-Summer-of-Code (2021)
DharmrajRathod98 updated the task description for T279488: Develop Dashboard with Flask For Database backup inventory improvements.
Apr 12 2021, 10:32 AM · dbbackups-dashboard, Google-Summer-of-Code (2021)
DharmrajRathod98 added a comment to T274636: Develop a web dashboard or a command line tool to help inventory and/or monitor database and backup objects.

can you please explain how to link them in backups table

Indeed, that is a really good question.

The backup table status has 3 possible explicit states:

  • ongoing: The backup has started, but it has not finished yet
  • failed: The backup started and finished with an error
  • finished: The backup finished with no errors (including tests of completeness)

There are, however, other states that could be inferred from other fields:

  • Backups are scheduled at a point in time, if there are no ongoing entries that have been scheduled, it means it is queued to be executed but not started yet
  • Metadata is started to be gathered before postprocessing- if there is any metadata, like the total size, you can know it is being postprocessed/pending to be compressed, etc.

The details are not that important for the proposal, as they would be for an initial analysis after the fact- e.g. if we consider we need more explicit states, we can add those to the original tool.

I hope that is clear.

Apr 12 2021, 10:30 AM · Google-Summer-of-Code (2021)
DharmrajRathod98 updated the task description for T279488: Develop Dashboard with Flask For Database backup inventory improvements.
Apr 12 2021, 10:29 AM · dbbackups-dashboard, Google-Summer-of-Code (2021)
DharmrajRathod98 updated the task description for T279488: Develop Dashboard with Flask For Database backup inventory improvements.
Apr 12 2021, 10:27 AM · dbbackups-dashboard, Google-Summer-of-Code (2021)
DharmrajRathod98 added a comment to T279488: Develop Dashboard with Flask For Database backup inventory improvements.

I can devote 40 hours/week for GSoC project

I think you are expected to dedicate 25h per week, or 40 hours, but take some days off in between. Please adjust your project outcome based on a total of 178h of work, I think is the guidelines (but please double confirm on the Google Summer of Code website).

I am worried about selection

Both Manuel and I haven't talked about the quality of any submission so far, and more likely only will do after the deadline. I haven't checked or compared your submission to that of anyone else. The submission is entirely judged on what you submit, and not compared to anyone else. There is (probably) only going to be 1 student selected among all submissions, independently of the idea. You should chose the idea that you see more interesting or fitting for your skills, not the one that is more likely to be chosen, because there is not such an idea. We will chose a student, not an idea.

Having said that, if you don't feel comfortable with your idea (for any reason), you can change it- but my advice is to not do it because it is repeated (all ideas are likely to be repeated by the end of the process)- that will make no difference. Focus on improving your proposal to demonstrate you are the best candidate. Last year, the top candidates chose different ideas purely by chance.

These are just answers to your questions, I will try to do a second pass later.

Apr 12 2021, 10:22 AM · dbbackups-dashboard, Google-Summer-of-Code (2021)
DharmrajRathod98 updated the task description for T279488: Develop Dashboard with Flask For Database backup inventory improvements.
Apr 12 2021, 10:20 AM · dbbackups-dashboard, Google-Summer-of-Code (2021)

Apr 8 2021

DharmrajRathod98 added a comment to T279488: Develop Dashboard with Flask For Database backup inventory improvements.

@jcrespo @Marostegui
Hello, what will happen as my and h.krishna's proposal are for same project idea. Is there any other way to resolve conflict ? should i propose for some other project idea ? I am worried about selection.

Apr 8 2021, 1:56 PM · dbbackups-dashboard, Google-Summer-of-Code (2021)

Apr 7 2021

DharmrajRathod98 added a comment to T279488: Develop Dashboard with Flask For Database backup inventory improvements.

Hello , @jcrespo @Marostegui
Can you please review my draft proposal?

Apr 7 2021, 11:20 AM · dbbackups-dashboard, Google-Summer-of-Code (2021)

Apr 6 2021

DharmrajRathod98 updated the task description for T279488: Develop Dashboard with Flask For Database backup inventory improvements.
Apr 6 2021, 10:45 PM · dbbackups-dashboard, Google-Summer-of-Code (2021)
DharmrajRathod98 added a parent task for T279488: Develop Dashboard with Flask For Database backup inventory improvements: T274636: Develop a web dashboard or a command line tool to help inventory and/or monitor database and backup objects.
Apr 6 2021, 10:40 PM · dbbackups-dashboard, Google-Summer-of-Code (2021)
DharmrajRathod98 added a subtask for T274636: Develop a web dashboard or a command line tool to help inventory and/or monitor database and backup objects: T279488: Develop Dashboard with Flask For Database backup inventory improvements.
Apr 6 2021, 10:40 PM · Google-Summer-of-Code (2021)
DharmrajRathod98 created T279488: Develop Dashboard with Flask For Database backup inventory improvements.
Apr 6 2021, 10:36 PM · dbbackups-dashboard, Google-Summer-of-Code (2021)

Apr 4 2021

DharmrajRathod98 added a comment to T274636: Develop a web dashboard or a command line tool to help inventory and/or monitor database and backup objects.

A web dashboard that tracks the status of ongoing backups (next scheduled run, running, postprocessing, finishing ETA, etc.)

@jcrespo
I evaluted the database but i could not able to find connection between 'backups(DB_ table) > status(table_field_value = ongoing) ' with (next scheduled run, running, postprocessing, finishing ETA, etc.) can you please explain how to link them in backups table ?

Apr 4 2021, 2:18 PM · Google-Summer-of-Code (2021)

Apr 3 2021

DharmrajRathod98 added a comment to T277754: Improve filename regex in cli/recover-dump .

your leetcode test cases seem to fail for the following inputs. I don't think it should, these inputs look fine to me
regex check failed for : dump.s3.2022-06-01--21-06-56.gz
regex check failed for : dump.s3.2021-03-19--12-05-32
You'll probably need to recheck your method a bit.

@jcrespo @h.krishna
dump.s3.2022-06-01--21-06-56.gz and dump.s3.2021-03-19--12-05-32 are failed because it is not ending with .tar.gz however, datetime is correct so, my function will return true for datetime validation but regex check failed for not ending with .tar.gz

Apr 3 2021, 4:05 AM · Data-Persistence-Backup, Patch-For-Review, good first task

Apr 1 2021

DharmrajRathod98 claimed T277754: Improve filename regex in cli/recover-dump .
Apr 1 2021, 11:25 AM · Data-Persistence-Backup, Patch-For-Review, good first task

Mar 29 2021

DharmrajRathod98 added a comment to T277754: Improve filename regex in cli/recover-dump .

@jcrespo @h.krishna
for validating time we can use regex and for validating date we can call a function is this correct ? that will be very easy to understand.

Mar 29 2021, 11:50 AM · Data-Persistence-Backup, Patch-For-Review, good first task
DharmrajRathod98 added a comment to T274636: Develop a web dashboard or a command line tool to help inventory and/or monitor database and backup objects.

@jcrespo

The simplest application you can think covering the given proposal is likely to be chosen, as quality will be valued over number of lines of code. 180h of work is not a lot to ship a complex piece of software, given analysis, design and testing will have to be included there.

Thankyou so much on explaining it so well. It cleared me a lot on do's and don'ts of writing proposal. I am supposed to fill this form
https://phabricator.wikimedia.org/maniphest/task/edit/form/1/
right?

Mar 29 2021, 11:49 AM · Google-Summer-of-Code (2021)
DharmrajRathod98 added a comment to T277754: Improve filename regex in cli/recover-dump .

@h.krishna very good comment, that is the kind of comment why I asked you to create a ticket.

Having a bare minumum regex (e.g. ...\d\d\d\d\-\d\d\-\d\d) + a call to validate the date would be a good option.

message to be printed as I had originally thought

It would be ok to print a DEBUG or at most an INFO one, but not anything above that (the print was too worrying). There is an expectation of having other section files on the same dir.

Mar 29 2021, 11:15 AM · Data-Persistence-Backup, Patch-For-Review, good first task
DharmrajRathod98 added a comment to T277754: Improve filename regex in cli/recover-dump .

Let me know if the function is the better idea then i will start implementing it but before that i should have clear idea what should the function contain.

Mar 29 2021, 4:01 AM · Data-Persistence-Backup, Patch-For-Review, good first task
DharmrajRathod98 added a comment to T277754: Improve filename regex in cli/recover-dump .

@jcrespo @h.krishna
i would suggest that to make the regex for leap year is more complicated so as you said we should use datetime module to validate. So function that validate datetime is better idea.
or another way is only validate leap year using code but in this case everytime we have to go through regex and code both. So i think better idea is to make function.

Mar 29 2021, 3:41 AM · Data-Persistence-Backup, Patch-For-Review, good first task

Mar 26 2021

DharmrajRathod98 added a comment to T277754: Improve filename regex in cli/recover-dump .

@jcrespo i am sorry about that i will be more carefull from the next time. so should i work on this now or hand over to @Sahilgrewalhere ?

Mar 26 2021, 9:52 AM · Data-Persistence-Backup, Patch-For-Review, good first task
DharmrajRathod98 added a comment to T277754: Improve filename regex in cli/recover-dump .

Change 675010 had a related patch set uploaded (by Sahilgrewalhere; author: Sahilgrewalhere):
[operations/software/wmfbackups@master] Improved filename regex in cli/recover-dump

https://gerrit.wikimedia.org/r/675010

@jcrespo
dump.s3.2022-11-12--19-05-35
dump.s3.2021-03-19--12-05-32

Mar 26 2021, 8:48 AM · Data-Persistence-Backup, Patch-For-Review, good first task

Mar 25 2021

DharmrajRathod98 claimed T277754: Improve filename regex in cli/recover-dump .
Mar 25 2021, 8:40 PM · Data-Persistence-Backup, Patch-For-Review, good first task
DharmrajRathod98 added a comment to T277754: Improve filename regex in cli/recover-dump .

@Sahilgrewalhere i am working on this so, please work on some different task.

Mar 25 2021, 8:29 PM · Data-Persistence-Backup, Patch-For-Review, good first task
DharmrajRathod98 added a comment to T277754: Improve filename regex in cli/recover-dump .

@jcrespo i want to work on this good first task.

Mar 25 2021, 10:28 AM · Data-Persistence-Backup, Patch-For-Review, good first task
DharmrajRathod98 added a comment to T274636: Develop a web dashboard or a command line tool to help inventory and/or monitor database and backup objects.

@jcrespo thank you very much.

Mar 25 2021, 9:57 AM · Google-Summer-of-Code (2021)

Mar 20 2021

DharmrajRathod98 added a comment to T274636: Develop a web dashboard or a command line tool to help inventory and/or monitor database and backup objects.

@jcrespo
i have added new repository at https://phabricator.wikimedia.org/diffusion/OSWB/ named " web" for frontend/web components. i have just added basic flask webapp which can be further modified as we add frontend/dashboard component. if any further changes required let me know and what should be the next step ? should i start integrating .sql with maria DB and put some basic components ?
for review..
https://gerrit.wikimedia.org/r/c/operations/software/wmfbackups/+/673693

Mar 20 2021, 1:37 PM · Google-Summer-of-Code (2021)
DharmrajRathod98 added a comment to T274636: Develop a web dashboard or a command line tool to help inventory and/or monitor database and backup objects.
Mar 20 2021, 10:28 AM · Google-Summer-of-Code (2021)

Mar 18 2021

DharmrajRathod98 added a comment to T274636: Develop a web dashboard or a command line tool to help inventory and/or monitor database and backup objects.

@jcrespo
for now , it is clear. i will let you know if any further changes required. i will try to add new respsitory for frontend/web.

Mar 18 2021, 7:53 PM · Google-Summer-of-Code (2021)
DharmrajRathod98 added a comment to T274636: Develop a web dashboard or a command line tool to help inventory and/or monitor database and backup objects.

@jcrespo
for Database backup inventory improvements this new project idea flask webapp would be better for me. Should i set up flask with Maria DB 10.4, Apache on my local (ubuntu 20.04 ) machine ? After that for testing i need to clone this (tox testing) operations/software/wmfbackups respository. Am i understood correctly?

For most of this project propoals, there is no existing code- a new repository will be setup so you start from 0. What exists is some related pieces of code or a database -that you can read and get an understanding what are the current usages. For example, for the database backup inventory, there is another repo for reading and writing to the database, and a database schema, but there is no existing code for a dashboard. You should download the .sql file and build the web dashboard around that database schema. I hope that is clear- please ask for further clarifications.

For everybody else: doing a deeper understanding of the requirements will be part of the project time.

@jcrespo
Thank you very much for clearing my queries. i think this much information is enough for me to understand the project idea. that would be great if you can provide link of another repo for reading and writing to the database, i have seen schemas from wiki/MariaDB/Backups#Metadata (if anything else is there please give me a link) and from where can i download .sql file for Database backup inventory improvements this specific project idea.

Mar 18 2021, 2:52 PM · Google-Summer-of-Code (2021)

Mar 16 2021

DharmrajRathod98 added a comment to T274636: Develop a web dashboard or a command line tool to help inventory and/or monitor database and backup objects.

@jcrespo
for Database backup inventory improvements this new project idea flask webapp would be better for me. Should i set up flask with Maria DB 10.4, Apache on my local (ubuntu 20.04 ) machine ? After that for testing i need to clone this (tox testing) operations/software/wmfbackups respository. Am i understood correctly?

Mar 16 2021, 10:48 PM · Google-Summer-of-Code (2021)

Mar 2 2021

DharmrajRathod98 added a comment to T274636: Develop a web dashboard or a command line tool to help inventory and/or monitor database and backup objects.

@DharmrajRathod98: Welcome and thanks for your interest. Can you please elaborate which specific areas / questions are unclear and require more guidance? Please see https://www.mediawiki.org/wiki/New_Developers - thanks a lot! :)

Mar 2 2021, 6:04 PM · Google-Summer-of-Code (2021)

Mar 1 2021

DharmrajRathod98 added a comment to T274636: Develop a web dashboard or a command line tool to help inventory and/or monitor database and backup objects.

Hello @jcrespo,
My name is Dharmraj Rathod. I am Currently pursuing Mtech at Indian Institute of Information and Technology Vadodara. I am quite new to open source but I am very excited to learn this things. I found the prerequisites of this project to be matching with my skillset and thus i am interested in contributing to this idea for GSOC-2021. Can you please guide me little bit ? so i can understand code base for this idea and start contributing some small tasks.

Mar 1 2021, 5:55 AM · Google-Summer-of-Code (2021)