Mentor @Ederporto had a doubt,
When calculating total number of article views suppose XXx in the month of January I am getting 459261 articles using the Wikimedia API link "https://wikimedia.org/api/rest_v1/metrics/pageviews/top/pt.wikipedia.org/all-access/2024/01/all-days"
But when calculating views of XXx each day in January and summing up the views getting 456323.
Even getting different of articles in a month as a whole using API link for whole month and different articles for whole month per day when summed up individually, common articles of each day are not counted again
Why is there such a difference?

In T358412#9633201, @MahimaSinghal wrote:

In T358412#9633199, @Aixvik wrote:

In T358412#9633197, @MahimaSinghal wrote:

In T358412#9633189, @Aixvik wrote:

In T358412#9633183, @MahimaSinghal wrote:

In T358412#9633179, @Aixvik wrote:

In T358412#9633100, @MahimaSinghal wrote:

In T358412#9632678, @Aixvik wrote:

Not able to generate video from the data frame? What might the reason be? As we have 7k+ columns and it's taking time can we generate a bar chart race video of only a few columns as an example?
And I read in the documentation that we should have 'ffmpeg' installed on our device as I am working on web paws Jupyter notebook and not locally do I also have to install 'ffmpeg'?

Download latest FFmpeg static build.

exist = !which ffmpeg
if not exist:

!curl https://johnvansickle.com/ffmpeg/releases/ffmpeg-release-amd64-static.tar.xz -o ffmpeg.tar.xz \
   && tar -xf ffmpeg.tar.xz && rm ffmpeg.tar.xz
ffmdir = !find . -iname ffmpeg-*-static
path = %env PATH
path = path + ':' + ffmdir[0]
%env PATH $path

!which ffmpeg
Add this code to your notebook , and you will be good to go.

Getting same error again.

Can you share the exact error, What are the errors you are getting Exactly?

KeyError Traceback (most recent call last)
File /srv/paws/lib/python3.10/site-packages/PIL/Image.py:2416, in Image.save(self, fp, format, **params)

2415 try:

-> 2416 format = EXTENSION[ext]

2417 except KeyError as e:

KeyError: '.mp4'

The above exception was the direct cause of the following exception:

ValueError Traceback (most recent call last)
File /srv/paws/lib/python3.10/site-packages/bar_chart_race/_make_chart.py:435, in _BarChartRace.make_animation(self)

434     else:

--> 435 ret_val = anim.save(self.filename, fps=self.fps, writer=self.writer)

436 except Exception as e:

File /srv/paws/lib/python3.10/site-packages/matplotlib/animation.py:1089, in Animation.save(self, filename, writer, fps, dpi, codec, bitrate, extra_args, metadata, extra_anim, savefig_kwargs, progress_callback)

1086 # canvas._is_saving = True makes the draw_event animation-starting
1087 # callback a no-op; canvas.manager = None prevents resizing the GUI
1088 # widget (both are likewise done in savefig()).

-> 1089 with writer.saving(self._fig, filename, dpi), \

1090      cbook._setattr_cm(self._fig.canvas, _is_saving=True, manager=None):
1091     for anim in all_anim:

File /usr/lib/python3.10/contextlib.py:142, in _GeneratorContextManager.exit(self, typ, value, traceback)

141 try:

--> 142 next(self.gen)

143 except StopIteration:

File /srv/paws/lib/python3.10/site-packages/matplotlib/animation.py:245, in AbstractMovieWriter.saving(self, fig, outfile, dpi, *args, **kwargs)

244 finally:

--> 245 self.finish()

File /srv/paws/lib/python3.10/site-packages/matplotlib/animation.py:515, in PillowWriter.finish(self)

514 def finish(self):

--> 515 self._frames[0].save(

516         self.outfile, save_all=True, append_images=self._frames[1:],
517         duration=int(1000 / self.fps), loop=0)

File /srv/paws/lib/python3.10/site-packages/PIL/Image.py:2419, in Image.save(self, fp, format, **params)

2418         msg = f"unknown file extension: {ext}"

-> 2419 raise ValueError(msg) from e

2421 if format.upper() not in SAVE:

ValueError: unknown file extension: .mp4

During handling of the above exception, another exception occurred:

Exception Traceback (most recent call last)
Cell In[8], line 11

 4     bcr.bar_chart_race(
 5         df=df,
 6         filename='AnalysisVideo.mp4',  
 7         title='Bar Chart Race',
 8         writer='matplotlib'
 9     )
10     return 'AnalysisVideo.mp4'

---> 11 video = dataframe_to_race_chart(first_20)

12 Video(video, embed=True)

Cell In[8], line 4, in dataframe_to_race_chart(df)

3 def dataframe_to_race_chart(df):

----> 4 bcr.bar_chart_race(

 5         df=df,
 6         filename='AnalysisVideo.mp4',  
 7         title='Bar Chart Race',
 8         writer='matplotlib'
 9     )
10     return 'AnalysisVideo.mp4'

File /srv/paws/lib/python3.10/site-packages/bar_chart_race/_make_chart.py:783, in bar_chart_race(df, filename, orientation, sort, n_bars, fixed_order, fixed_max, steps_per_period, period_length, interpolate_period, label_bars, bar_size, period_label, period_fmt, period_summary_func, perpendicular_bar_func, figsize, cmap, title, title_size, bar_label_size, tick_label_size, shared_fontdict, scale, writer, fig, dpi, bar_kwargs, filter_column_colors)

 461 '''
 462 Create an animated bar chart race using matplotlib. Data must be in 
 463 'wide' format where each row represents a single time period and each 
(...)
 776 These sizes are relative to plt.rcParams['font.size'].
 777 '''
 778 bcr = _BarChartRace(df, filename, orientation, sort, n_bars, fixed_order, fixed_max,
 779                     steps_per_period, period_length, interpolate_period, label_bars, bar_size, 
 780                     period_label, period_fmt, period_summary_func, perpendicular_bar_func, 
 781                     figsize, cmap, title, title_size, bar_label_size, tick_label_size, 
 782                     shared_fontdict, scale, writer, fig, dpi, bar_kwargs, filter_column_colors)

--> 783 return bcr.make_animation()

File /srv/paws/lib/python3.10/site-packages/bar_chart_race/_make_chart.py:446, in _BarChartRace.make_animation(self)

444     else:
445         message = str(e)

--> 446 raise Exception(message)

447 finally:
448     plt.rcParams = self.orig_rcParams

Exception: You do not have ffmpeg installed on your machine. Download

ffmpeg from here: https://www.ffmpeg.org/download.html.

Matplotlib's original error message below:

unknown file extension: .mp4

What output do you get after running this code, specific to this code block:

If the code I provided would have executed correctly, then you should have a folder named ffmpeg in your home folder.

% Total % Received % Xferd Average Speed Time Time Time Current

Dload  Upload   Total   Spent    Left  Speed

100 39.4M 100 39.4M 0 0 144M 0 --:--:-- --:--:-- --:--:-- 145M
env: PATH=/srv/paws/pwb:/srv/paws/bin:/srv/paws:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/srv/openrefine:/srv/julia/bin:./ffmpeg-6.1-amd64-static
./ffmpeg-6.1-amd64-static/ffmpeg

I got this.

So this implies, you must be having a folder named ffmpeg-6.1-amd64-static in your home folder.
{F42634524}

In T358412#9633197, @MahimaSinghal wrote:

In T358412#9633189, @Aixvik wrote:

In T358412#9633183, @MahimaSinghal wrote:

In T358412#9633179, @Aixvik wrote:

In T358412#9633100, @MahimaSinghal wrote:

In T358412#9632678, @Aixvik wrote:

Not able to generate video from the data frame? What might the reason be? As we have 7k+ columns and it's taking time can we generate a bar chart race video of only a few columns as an example?
And I read in the documentation that we should have 'ffmpeg' installed on our device as I am working on web paws Jupyter notebook and not locally do I also have to install 'ffmpeg'?

Download latest FFmpeg static build.

exist = !which ffmpeg
if not exist:

!curl https://johnvansickle.com/ffmpeg/releases/ffmpeg-release-amd64-static.tar.xz -o ffmpeg.tar.xz \
   && tar -xf ffmpeg.tar.xz && rm ffmpeg.tar.xz
ffmdir = !find . -iname ffmpeg-*-static
path = %env PATH
path = path + ':' + ffmdir[0]
%env PATH $path

!which ffmpeg
Add this code to your notebook , and you will be good to go.

Getting same error again.

Can you share the exact error, What are the errors you are getting Exactly?

KeyError Traceback (most recent call last)
File /srv/paws/lib/python3.10/site-packages/PIL/Image.py:2416, in Image.save(self, fp, format, **params)

2415 try:

-> 2416 format = EXTENSION[ext]

2417 except KeyError as e:

KeyError: '.mp4'

The above exception was the direct cause of the following exception:

ValueError Traceback (most recent call last)
File /srv/paws/lib/python3.10/site-packages/bar_chart_race/_make_chart.py:435, in _BarChartRace.make_animation(self)

434     else:

--> 435 ret_val = anim.save(self.filename, fps=self.fps, writer=self.writer)

436 except Exception as e:

File /srv/paws/lib/python3.10/site-packages/matplotlib/animation.py:1089, in Animation.save(self, filename, writer, fps, dpi, codec, bitrate, extra_args, metadata, extra_anim, savefig_kwargs, progress_callback)

1086 # canvas._is_saving = True makes the draw_event animation-starting
1087 # callback a no-op; canvas.manager = None prevents resizing the GUI
1088 # widget (both are likewise done in savefig()).

-> 1089 with writer.saving(self._fig, filename, dpi), \

1090      cbook._setattr_cm(self._fig.canvas, _is_saving=True, manager=None):
1091     for anim in all_anim:

File /usr/lib/python3.10/contextlib.py:142, in _GeneratorContextManager.exit(self, typ, value, traceback)

141 try:

--> 142 next(self.gen)

143 except StopIteration:

File /srv/paws/lib/python3.10/site-packages/matplotlib/animation.py:245, in AbstractMovieWriter.saving(self, fig, outfile, dpi, *args, **kwargs)

244 finally:

--> 245 self.finish()

File /srv/paws/lib/python3.10/site-packages/matplotlib/animation.py:515, in PillowWriter.finish(self)

514 def finish(self):

--> 515 self._frames[0].save(

516         self.outfile, save_all=True, append_images=self._frames[1:],
517         duration=int(1000 / self.fps), loop=0)

File /srv/paws/lib/python3.10/site-packages/PIL/Image.py:2419, in Image.save(self, fp, format, **params)

2418         msg = f"unknown file extension: {ext}"

-> 2419 raise ValueError(msg) from e

2421 if format.upper() not in SAVE:

ValueError: unknown file extension: .mp4

During handling of the above exception, another exception occurred:

Exception Traceback (most recent call last)
Cell In[8], line 11

 4     bcr.bar_chart_race(
 5         df=df,
 6         filename='AnalysisVideo.mp4',  
 7         title='Bar Chart Race',
 8         writer='matplotlib'
 9     )
10     return 'AnalysisVideo.mp4'

---> 11 video = dataframe_to_race_chart(first_20)

12 Video(video, embed=True)

Cell In[8], line 4, in dataframe_to_race_chart(df)

3 def dataframe_to_race_chart(df):

----> 4 bcr.bar_chart_race(

 5         df=df,
 6         filename='AnalysisVideo.mp4',  
 7         title='Bar Chart Race',
 8         writer='matplotlib'
 9     )
10     return 'AnalysisVideo.mp4'

File /srv/paws/lib/python3.10/site-packages/bar_chart_race/_make_chart.py:783, in bar_chart_race(df, filename, orientation, sort, n_bars, fixed_order, fixed_max, steps_per_period, period_length, interpolate_period, label_bars, bar_size, period_label, period_fmt, period_summary_func, perpendicular_bar_func, figsize, cmap, title, title_size, bar_label_size, tick_label_size, shared_fontdict, scale, writer, fig, dpi, bar_kwargs, filter_column_colors)

 461 '''
 462 Create an animated bar chart race using matplotlib. Data must be in 
 463 'wide' format where each row represents a single time period and each 
(...)
 776 These sizes are relative to plt.rcParams['font.size'].
 777 '''
 778 bcr = _BarChartRace(df, filename, orientation, sort, n_bars, fixed_order, fixed_max,
 779                     steps_per_period, period_length, interpolate_period, label_bars, bar_size, 
 780                     period_label, period_fmt, period_summary_func, perpendicular_bar_func, 
 781                     figsize, cmap, title, title_size, bar_label_size, tick_label_size, 
 782                     shared_fontdict, scale, writer, fig, dpi, bar_kwargs, filter_column_colors)

--> 783 return bcr.make_animation()

File /srv/paws/lib/python3.10/site-packages/bar_chart_race/_make_chart.py:446, in _BarChartRace.make_animation(self)

444     else:
445         message = str(e)

--> 446 raise Exception(message)

447 finally:
448     plt.rcParams = self.orig_rcParams

Exception: You do not have ffmpeg installed on your machine. Download

ffmpeg from here: https://www.ffmpeg.org/download.html.

Matplotlib's original error message below:

unknown file extension: .mp4

What output do you get after running this code, specific to this code block:

If the code I provided would have executed correctly, then you should have a folder named ffmpeg in your home folder.

In T358412#9633193, @Abishek_Das wrote:

In T358412#9633189, @Aixvik wrote:

In T358412#9633183, @MahimaSinghal wrote:

In T358412#9633179, @Aixvik wrote:

In T358412#9633100, @MahimaSinghal wrote:

In T358412#9632678, @Aixvik wrote:

Not able to generate video from the data frame? What might the reason be? As we have 7k+ columns and it's taking time can we generate a bar chart race video of only a few columns as an example?
And I read in the documentation that we should have 'ffmpeg' installed on our device as I am working on web paws Jupyter notebook and not locally do I also have to install 'ffmpeg'?

Download latest FFmpeg static build.

exist = !which ffmpeg
if not exist:

!curl https://johnvansickle.com/ffmpeg/releases/ffmpeg-release-amd64-static.tar.xz -o ffmpeg.tar.xz \
   && tar -xf ffmpeg.tar.xz && rm ffmpeg.tar.xz
ffmdir = !find . -iname ffmpeg-*-static
path = %env PATH
path = path + ':' + ffmdir[0]
%env PATH $path

!which ffmpeg
Add this code to your notebook , and you will be good to go.

Getting same error again.

Can you share the exact error, What are the errors you are getting Exactly?

KeyError Traceback (most recent call last)
File /srv/paws/lib/python3.10/site-packages/PIL/Image.py:2416, in Image.save(self, fp, format, **params)

2415 try:

-> 2416 format = EXTENSION[ext]

2417 except KeyError as e:

KeyError: '.mp4'

The above exception was the direct cause of the following exception:

ValueError Traceback (most recent call last)
File /srv/paws/lib/python3.10/site-packages/bar_chart_race/_make_chart.py:435, in _BarChartRace.make_animation(self)

434     else:

--> 435 ret_val = anim.save(self.filename, fps=self.fps, writer=self.writer)

436 except Exception as e:

File /srv/paws/lib/python3.10/site-packages/matplotlib/animation.py:1089, in Animation.save(self, filename, writer, fps, dpi, codec, bitrate, extra_args, metadata, extra_anim, savefig_kwargs, progress_callback)

1086 # canvas._is_saving = True makes the draw_event animation-starting
1087 # callback a no-op; canvas.manager = None prevents resizing the GUI
1088 # widget (both are likewise done in savefig()).

-> 1089 with writer.saving(self._fig, filename, dpi), \

1090      cbook._setattr_cm(self._fig.canvas, _is_saving=True, manager=None):
1091     for anim in all_anim:

File /usr/lib/python3.10/contextlib.py:142, in _GeneratorContextManager.exit(self, typ, value, traceback)

141 try:

--> 142 next(self.gen)

143 except StopIteration:

File /srv/paws/lib/python3.10/site-packages/matplotlib/animation.py:245, in AbstractMovieWriter.saving(self, fig, outfile, dpi, *args, **kwargs)

244 finally:

--> 245 self.finish()

File /srv/paws/lib/python3.10/site-packages/matplotlib/animation.py:515, in PillowWriter.finish(self)

514 def finish(self):

--> 515 self._frames[0].save(

516         self.outfile, save_all=True, append_images=self._frames[1:],
517         duration=int(1000 / self.fps), loop=0)

File /srv/paws/lib/python3.10/site-packages/PIL/Image.py:2419, in Image.save(self, fp, format, **params)

2418         msg = f"unknown file extension: {ext}"

-> 2419 raise ValueError(msg) from e

2421 if format.upper() not in SAVE:

ValueError: unknown file extension: .mp4

During handling of the above exception, another exception occurred:

Exception Traceback (most recent call last)
Cell In[8], line 11

 4     bcr.bar_chart_race(
 5         df=df,
 6         filename='AnalysisVideo.mp4',  
 7         title='Bar Chart Race',
 8         writer='matplotlib'
 9     )
10     return 'AnalysisVideo.mp4'

---> 11 video = dataframe_to_race_chart(first_20)

12 Video(video, embed=True)

Cell In[8], line 4, in dataframe_to_race_chart(df)

3 def dataframe_to_race_chart(df):

----> 4 bcr.bar_chart_race(

 5         df=df,
 6         filename='AnalysisVideo.mp4',  
 7         title='Bar Chart Race',
 8         writer='matplotlib'
 9     )
10     return 'AnalysisVideo.mp4'

File /srv/paws/lib/python3.10/site-packages/bar_chart_race/_make_chart.py:783, in bar_chart_race(df, filename, orientation, sort, n_bars, fixed_order, fixed_max, steps_per_period, period_length, interpolate_period, label_bars, bar_size, period_label, period_fmt, period_summary_func, perpendicular_bar_func, figsize, cmap, title, title_size, bar_label_size, tick_label_size, shared_fontdict, scale, writer, fig, dpi, bar_kwargs, filter_column_colors)

 461 '''
 462 Create an animated bar chart race using matplotlib. Data must be in 
 463 'wide' format where each row represents a single time period and each 
(...)
 776 These sizes are relative to plt.rcParams['font.size'].
 777 '''
 778 bcr = _BarChartRace(df, filename, orientation, sort, n_bars, fixed_order, fixed_max,
 779                     steps_per_period, period_length, interpolate_period, label_bars, bar_size, 
 780                     period_label, period_fmt, period_summary_func, perpendicular_bar_func, 
 781                     figsize, cmap, title, title_size, bar_label_size, tick_label_size, 
 782                     shared_fontdict, scale, writer, fig, dpi, bar_kwargs, filter_column_colors)

--> 783 return bcr.make_animation()

File /srv/paws/lib/python3.10/site-packages/bar_chart_race/_make_chart.py:446, in _BarChartRace.make_animation(self)

444     else:
445         message = str(e)

--> 446 raise Exception(message)

447 finally:
448     plt.rcParams = self.orig_rcParams

Exception: You do not have ffmpeg installed on your machine. Download

ffmpeg from here: https://www.ffmpeg.org/download.html.

Matplotlib's original error message below:

unknown file extension: .mp4

You do not have ffmpeg installed on your machine. ffmpeg is not install successfully on your system. You can try the steps mentioned by me on how to install ffmpeg its little bit long 😅 but i think will work.

In T358412#9633183, @MahimaSinghal wrote:

In T358412#9633179, @Aixvik wrote:

In T358412#9633100, @MahimaSinghal wrote:

In T358412#9632678, @Aixvik wrote:

Not able to generate video from the data frame? What might the reason be? As we have 7k+ columns and it's taking time can we generate a bar chart race video of only a few columns as an example?
And I read in the documentation that we should have 'ffmpeg' installed on our device as I am working on web paws Jupyter notebook and not locally do I also have to install 'ffmpeg'?

Download latest FFmpeg static build.

exist = !which ffmpeg
if not exist:

!curl https://johnvansickle.com/ffmpeg/releases/ffmpeg-release-amd64-static.tar.xz -o ffmpeg.tar.xz \
   && tar -xf ffmpeg.tar.xz && rm ffmpeg.tar.xz
ffmdir = !find . -iname ffmpeg-*-static
path = %env PATH
path = path + ':' + ffmdir[0]
%env PATH $path

!which ffmpeg
Add this code to your notebook , and you will be good to go.

Getting same error again.

Can you share the exact error, What are the errors you are getting Exactly?

In T358412#9633183, @MahimaSinghal wrote:

In T358412#9633179, @Aixvik wrote:

In T358412#9633100, @MahimaSinghal wrote:

In T358412#9632678, @Aixvik wrote:

Not able to generate video from the data frame? What might the reason be? As we have 7k+ columns and it's taking time can we generate a bar chart race video of only a few columns as an example?
And I read in the documentation that we should have 'ffmpeg' installed on our device as I am working on web paws Jupyter notebook and not locally do I also have to install 'ffmpeg'?

Download latest FFmpeg static build.

exist = !which ffmpeg
if not exist:

!curl https://johnvansickle.com/ffmpeg/releases/ffmpeg-release-amd64-static.tar.xz -o ffmpeg.tar.xz \
   && tar -xf ffmpeg.tar.xz && rm ffmpeg.tar.xz
ffmdir = !find . -iname ffmpeg-*-static
path = %env PATH
path = path + ':' + ffmdir[0]
%env PATH $path

!which ffmpeg
Add this code to your notebook , and you will be good to go.

Getting same error again.

Can you share the exact error, What are the errors you are getting Exactly?

In T358412#9633169, @Abishek_Das wrote:

In T358412#9632678, @Aixvik wrote:

Not able to generate video from the data frame? What might the reason be? As we have 7k+ columns and it's taking time can we generate a bar chart race video of only a few columns as an example?
And I read in the documentation that we should have 'ffmpeg' installed on our device as I am working on web paws Jupyter notebook and not locally do I also have to install 'ffmpeg'?

After installing ffmpeg try to add only few rows and columns to check everything works properly

In T358412#9633100, @MahimaSinghal wrote:

In T358412#9632678, @Aixvik wrote:

Not able to generate video from the data frame? What might the reason be? As we have 7k+ columns and it's taking time can we generate a bar chart race video of only a few columns as an example?
And I read in the documentation that we should have 'ffmpeg' installed on our device as I am working on web paws Jupyter notebook and not locally do I also have to install 'ffmpeg'?

Download latest FFmpeg static build.

exist = !which ffmpeg
if not exist:

!curl https://johnvansickle.com/ffmpeg/releases/ffmpeg-release-amd64-static.tar.xz -o ffmpeg.tar.xz \
   && tar -xf ffmpeg.tar.xz && rm ffmpeg.tar.xz
ffmdir = !find . -iname ffmpeg-*-static
path = %env PATH
path = path + ':' + ffmdir[0]
%env PATH $path

!which ffmpeg
Add this code to your notebook , and you will be good to go.

Actually one more problem is there, memory of the paws notebook is fixed 3GB and this work is requiring more how to increase that limit? Have all of you done without increasing the memory?

Not able to generate video from the data frame? What might the reason be? As we have 7k+ columns and it's taking time can we generate a bar chart race video of only a few columns as an example?
And I read in the documentation that we should have 'ffmpeg' installed on our device as I am working on web paws Jupyter notebook and not locally do I also have to install 'ffmpeg'?

In T358412#9632453, @MahimaSinghal wrote:

In T358412#9632442, @Aixvik wrote:

I have generated both data frames of monthly as well as daily report of January and February. But don't know the process of removing false positives. How to proceed with this?

I think we have to refer to this page https://pageviews.wmcloud.org/topviews/faq/#false_positive for the process of removing false positives.

I have generated both data frames of monthly as well as daily report of January and February. But don't know the process of removing false positives. How to proceed with this?

@all Please can you help me in removing false positive cases? @Ederporto please guide me in this.

@all project 2 microtask A, I am not able to execute the second command to find "A function to get a dataframe of the most viewed articles in the Portuguese Wikipedia for the period of January 1st, 2024 and February 29th, 2024"
As we have API's of finding most viewed articles per day , or for the whole month combined. How to get so many top viewed articles for everyday in January and February?
Mentor @Ederporto please help me out.

Had a doubt, I was asked to complete task T358412 , when i landed on this page I found the task T357409 and after learning and research I have done most part of it. Am I in the right direction or not? Mentor @Ederporto please help me.