Carlos-Francisco Méndez-Cruz / nlp-preprocessing-pipeline

Go to a project
Toggle navigation Toggle navigation pinning
Carlos-Francisco Méndez-Cruz
9321869a 1 parent 34198579

New terminological tagging for CRFs

Inline Side-by-side
Showing 1 changed file with 4 additions and 1 deletions
......@@ -108,7 +108,7 @@ if __name__ == "__main__":
hashTermsOrig[key].append(line.capitalize())
print(' Terms read {} size: {}'.format(key, len(hashTerms[key])))
print(' Terms read {} size: {}'.format(key, len(hashTermsOrig[key])))
print("hashTermsOrig: {}".format(hashTermsOrig))
#print("hashTermsOrig: {}".format(hashTermsOrig))
#regularWords = words.words('en')
print()
......@@ -164,6 +164,9 @@ if __name__ == "__main__":
line = listLine1[0] + '\t' + listLine1[1] + '\t' + listLine2[0] + ' ' + 'O' + ' TermTag'
# line = listLine1[0] + '\t' + termTag + '\t' + listLine2[0] + ' ' + termTag + ' TermTag'
#line = word + '\t' + termTag + '\t' + lemma + ' ' + termTag + ' TermTag'
if found:
oFile.write(line)
else:
oFile.write(line + '\n')
filesPreprocessed += 1
......