Difference between revisions of "Workdocumentation 2021-03-30"
Jump to navigation
Jump to search
Musaab Khan (talk | contribs) |
Musaab Khan (talk | contribs) |
||
| Line 23: | Line 23: | ||
</source> | </source> | ||
| − | === Improper Null values for Has person == | + | === Improper Null values for Has person === |
* Has person was using "some person" as a null value. There was incorrect usage where in the free text events would use some person while the Wikison Format info would contain the person name. | * Has person was using "some person" as a null value. There was incorrect usage where in the free text events would use some person while the Wikison Format info would contain the person name. | ||
# First way of doing this is to remove free text altogether. A code snippet was used coupled with bash utility grep. Usage: | # First way of doing this is to remove free text altogether. A code snippet was used coupled with bash utility grep. Usage: | ||
| Line 29: | Line 29: | ||
grep 'some person' -r 'C:/Users/92031/wikibackup/ormk/' -l | python scripts/Data_Fixes.py -stdin -ro -rmf | wikirestore -t ormk -stdinp -ui | grep 'some person' -r 'C:/Users/92031/wikibackup/ormk/' -l | python scripts/Data_Fixes.py -stdin -ro -rmf | wikirestore -t ormk -stdinp -ui | ||
</source> | </source> | ||
| − | Output page: [https://confident.dbis.rwth-aachen.de/ormk/index.php?title=ICFHR_2020 ICFHR 2020] | + | Output page: [https://confident.dbis.rwth-aachen.de/ormk/index.php?title=ICFHR_2020&type=revision&diff=19206&oldid=15877 ICFHR 2020] |
# Second way to do this is to only remove the 'some person' entry from the wiki free text. Python snippet is used with bash utility grep. Usage: | # Second way to do this is to only remove the 'some person' entry from the wiki free text. Python snippet is used with bash utility grep. Usage: | ||
<source lang='bash'> | <source lang='bash'> | ||
Revision as of 23:57, 30 March 2021
Red Links and Data Fixations
Broken redirects
- The list of all broken redirects on openresearch can be found here: https://www.openresearch.org/mediawiki/index.php?title=Special:BrokenRedirects&limit=500&offset=0
Broken file links
- List of all broken links which contain a file path but the file does not exist can be found here: https://www.openresearch.org/wiki/Category:Pages_with_broken_file_links
Broken properties and errors
- The property Property:Has improper value for stores all invalid values.
Ordinals
- For the Fix for ordinals the following approaches can be used :
- This approach finds and edits all events with improper ordinals fixed:
wikiedit -t wikiId -q "[[Has improper value for::Ordinal]]" --search "(\|Ordinal=[0-9]+)(?:st|nd|rd|th)\b" --replace "\1"
- A code snippet can be used coupled with wikibackup and bash tools for specific editing of pages: Code Snippet
- Pipeline usage:
grep Ordinal C:/Users/92031/wikibackup/ormk -l -r | python ordinal_to_cardinal.py -stdin -d '../dictionary.yaml' -ro -f | wikirestore -t ormk -stdinp -ui
Improper Null values for Has person
- Has person was using "some person" as a null value. There was incorrect usage where in the free text events would use some person while the Wikison Format info would contain the person name.
- First way of doing this is to remove free text altogether. A code snippet was used coupled with bash utility grep. Usage:
grep 'some person' -r 'C:/Users/92031/wikibackup/ormk/' -l | python scripts/Data_Fixes.py -stdin -ro -rmf | wikirestore -t ormk -stdinp -ui
Output page: ICFHR 2020
- Second way to do this is to only remove the 'some person' entry from the wiki free text. Python snippet is used with bash utility grep. Usage:
grep 'some person' -r 'C:/Users/92031/wikibackup/ormk/' -l | python scripts/Data_Fixes.py -stdin -ro -rdf | wikirestore -t ormk -stdinp -ui
output page: ACCV_2020