Carlos-Francisco Méndez-Cruz / conditional-random-fields

Go to a project
Toggle navigation Toggle navigation pinning
Carlos-Francisco Méndez-Cruz
4df2dfa6 1 parent a709b026

Obtaining training and test data sets

Inline Side-by-side
Showing 1 changed file with 2 additions and 2 deletions
...@@ -63,13 +63,13 @@ if __name__ == "__main__": ...@@ -63,13 +63,13 @@ if __name__ == "__main__":
63 # For each file in dir 63 # For each file in dir
64 for file in files: 64 for file in files:
65 if counter <= 70: 65 if counter <= 70:
66 - print(" Joining file {} to training data set".format(file)) 66 + print(" Joining file {} {} to training data set".format(counter, file))
67 with open(os.path.join(path, file), "r", encoding="utf-8", errors="replace") as iFile: 67 with open(os.path.join(path, file), "r", encoding="utf-8", errors="replace") as iFile:
68 for line in iFile: 68 for line in iFile:
69 line = line.strip('\r\n') 69 line = line.strip('\r\n')
70 trainingDataset.append(line) 70 trainingDataset.append(line)
71 elif counter > 70 and counter <= 100: 71 elif counter > 70 and counter <= 100:
72 - print(" Joining file {} to test data set".format(file)) 72 + print(" Joining file {} {} to test data set".format(counter, file))
73 with open(os.path.join(path, file), "r", encoding="utf-8", errors="replace") as iFile: 73 with open(os.path.join(path, file), "r", encoding="utf-8", errors="replace") as iFile:
74 for line in iFile: 74 for line in iFile:
75 line = line.strip('\r\n') 75 line = line.strip('\r\n')
......