Page MenuHomePhabricator
Create Task
Maniphest T74005

(Indic) Hindi and sanskrit letters rendered as squares in PDFs
Closed, DeclinedPublic
Actions

Description

Author: sushant_savla

Description:
This is regarding the error which occurs while converting Gujarati wiki Source books in to PDF format.

Many a times bookes written in Gujarati Language contain quotes written in Hindi or sanskrit.

while converting, Text written in gujarati gets proeperly converted, but the words that are written in Hindi or sanskrit language appears as square Blocks.

Example : convert this book [[સભ્ય:Sushant savla/પુસ્તકો/બુદ્ધ અને મહાવીર]] in PDF, refer Page No. 12 pf the PDF converted version; there will be Square in place of Hindi / Sanskrit text.

Version: unspecified
Severity: normal

Details

Reference
bz72005

Related Objects
Search...

Event Timeline

• bzimport raised the priority of this task from to Needs Triage.Nov 22 2014, 3:51 AM
• bzimport added a project: OCG-PDF-renderer.
• bzimport set Reference to bz72005.
• bzimport added a subscriber: Unknown Object (MLST).
• bzimport created this task.Oct 13 2014, 5:34 PM
Aklapper added a comment.Oct 13 2014, 7:24 PM

Currently cannot test as I run into bug 71993.
Attaching the PDF is welcome.

I assume the "error" is just an incorrect / missing font?

Full link: https://gu.wikisource.org/wiki/%E0%AA%B8%E0%AA%AD%E0%AB%8D%E0%AA%AF:Sushant_savla/%E0%AA%AA%E0%AB%81%E0%AA%B8%E0%AB%8D%E0%AA%A4%E0%AA%95%E0%AB%8B/%E0%AA%AC%E0%AB%81%E0%AA%A6%E0%AB%8D%E0%AA%A7_%E0%AA%85%E0%AA%A8%E0%AB%87_%E0%AA%AE%E0%AA%B9%E0%AA%BE%E0%AA%B5%E0%AB%80%E0%AA%B0

• bzimport added a comment.Oct 15 2014, 3:51 PM

sushant_savla wrote:

I am not awareas to

• bzimport added a comment.Oct 15 2014, 3:55 PM

sushant_savla wrote:

sample of PDF convrted file

Sample file, where hinidi and sanskrit fonts are not rendered.

Page 4 (last word in bracket)
Page 12

Attached:

gujarati_book.pdf206 KBDownload

Aklapper added a comment.Oct 15 2014, 5:00 PM

Thanks! Confirming.
Also for me, every chapter string before the number in the header, plus the footer page number on the table of content page are squares here.

• bzimport added a comment.Oct 16 2014, 3:52 PM

sushant_savla wrote:

Yes, Same happens with me as well. I don't know what text could be there in front of Chapter number. checked book on english wiki source and found that it is word "Chapter" which can be translated in Gujarati as "પ્રકરણ"

cscott subscribed.Jul 19 2015, 4:06 PM

The hindi text should be surrounded by a <span lang="hi"> tag. This will switch the font (and select the proper language-dependent hyphenation/etc rules).

As a workaround, a future version of OCG will try "harder" to automatically recognize language switches when language attributes are not present (T106277). But that will never work as well as manually labelling the correct language of the text.

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJul 19 2015, 4:06 PM
cscott added a subtask: T106277: Automatically infer language from unicode character class.Jul 19 2015, 4:07 PM
Reedy removed a subscriber: • wikibugs-l-list.Nov 29 2015, 2:06 PM
Restricted Application added a subscriber: StudiesWorld. · View Herald TranscriptNov 29 2015, 2:06 PM
Jdforrester-WMF added a project: OCG-PDFRenderer.Apr 8 2016, 2:50 PM
Jdforrester-WMF removed a project: OCG-PDF-renderer.Apr 8 2016, 2:52 PM
NehalDaveND subscribed.Feb 13 2017, 10:50 AM

as Sanskrit Wikipedian can I help here?

Aklapper added a comment.Feb 13 2017, 11:09 AM

@NehalDaveND: There is an idea to move away from OfflineContentGenerator to Electron. You could test Hindi and Sanskrit letters on https://www.mediawiki.org/wiki/User:NehalDaveND/Sandbox and then create a PDF via https://www.mediawiki.org/w/index.php?title=Special:ElectronPdf&page=User%3ANehalDaveND%2FSandbox . If there are problems, report them under https://phabricator.wikimedia.org/maniphest/task/edit/form/1/?projects=electron-pdfs (as this task T74005 is about OCG and not Electron). Thanks!

Aklapper added a comment.Sep 14 2017, 10:39 AM

As already announced in Tech News, OfflineContentGenerator (OCG) will not be used anymore after October 1st, 2017 on Wikimedia sites. OCG will be replaced by Electron. You can read more on mediawiki.org.

Capankajsmilyo subscribed.May 7 2018, 3:43 PM
Aklapper closed subtask T106277: Automatically infer language from unicode character class as Declined.Feb 28 2021, 9:53 AM
Aklapper closed this task as Declined.Feb 28 2021, 11:02 AM
Aklapper added a project: I18n.

Tstcase at https://gu.wikisource.org/wiki/સભ્ય:Sushant_savla/પુસ્તકો/બુદ્ધ_અને_મહાવીર is gone. :( Given that even T73798 renders characters correctly nowadays that we use Proton and Electron-PDFs on Wikimedia servers, instead of OCG which was used at the time that this ticket was created, I am quite confident that this fixed nowadays by using Proton and Electron-PDFs. I am declining this task as it is about OCG, and OCG has been dead for years and superseded by Proton and Electron-PDFs on Wikimedia servers.

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL