ConMask icon indicating copy to clipboard operation
ConMask copied to clipboard

How preprosessing of dbpedia was done?

Open izuna385 opened this issue 5 years ago • 0 comments

Thanks for uploading code. I'm really interested in your work. My question is how to preprocess dbpedia datasets, because descriptions.txt contains, something like Paris,_Texas 2056 paris texas city county seat lamar county texas united states 2010 census population city 25 171 situated northeast texas western edge piney woods northeast dallas–fort worth metroplex ...

and I can't find out where the sentence boundary is. Also, I'd like to replace lemmatized token to original one.

If you'd know how the preprocessing of dbpedia was done, I'd really appreciate it. Thanks.

izuna385 avatar Nov 22 '19 16:11 izuna385