Bilingual drills

Run!    Kaç!    CC-BY 2.0 (France) Attribution: tatoeba.org #906328 (papabear) & #2322529 (Gulo_Luscus)

Doubtless there exists in this world precisely the right woman for 
any given man to marry and vice versa; but when you consider 
that a human being has the opportunity of being acquainted with 
only a few hundred people, and out of the few hundred that there 
are but a dozen or less whom he knows intimately, and out of the 
dozen, one or two friends at most, it will easily be seen, when we 
remember the number of millions who inhabit this world, that 
probably, since the earth was created, the right man has never yet 
met the right woman.       

Kuşkusuz bu dünyada her erkeğin ve kadının evlenmek için huyu huyuna, 
suyu suyuna tamamen denk birisi mutlaka vardır; fakat bir insanın sadece 
birkaç yüz kişiyle tanışma fırsatı bulduğu, bu birkaç yüz kişi içinden belki 
bir düzinesini yakından tanıdığı, bu bir düzinenin de ancak birkaçıyla dost 
olduğu göz önüne alınır ve de dünyada milyonlarca insanın yaşadığı 
hatırda tutulursa kolayca görülür ki dünya yaratıldığından beri doğru 
erkek doğru kadınla muhtemelen daha hiç karşılaşmamıştır.    

CC-BY 2.0 (France) Attribution: tatoeba.org #7697649 (RM) & #7730062 (soliloquist)

from collections import defaultdict
from pathlib import Path

language_1 = "English"
language_2 = "Turkish"

# language_1_sentence : [list of equivalent language_2 sentences]
l1_to_l2 = defaultdict(list)
# language_2_sentence : [list of equivalent language_1 sentences]
l2_to_l1 = defaultdict(list)

# the English-Turkish file was called tur.txt
with open("tur.txt") as f:
  for line in f:
      parts = line.strip().split('\t')
      l1_to_l2[parts[0]].append(parts[1])
      l2_to_l1[parts[1]].append(parts[0])

# [language_1 sentence] : [list of language_1 sentences with the same translation]
reduced_l1_keys = defaultdict(set)

for key in l1_to_l2:
    reduced_l1_keys[key].add(key)
    for val in l1_to_l2[key]:
	reduced_l1_keys[key] = reduced_l1_keys[key].union(l2_to_l1[val])

# [list of [list of language_1 sentences]] sorted by the average length of the sentence (in language_1)
l1_keys = sorted(set(tuple(v) for v in reduced_l1_keys.values()),
		 key=lambda x: sum(len(y) for y in x) / len(x))

print("Number of sentences:", len(l1_keys))
num_per_drill_file = 500
print("Number of drill files:", len(l1_keys) // num_per_drill_file)
num_per_drill_folder = 5
print("Number of drill folders:", len(l1_keys) // num_per_drill_file // num_per_drill_folder)

folder_index = 0
for i, r in enumerate(range(0, len(l1_keys), num_per_drill_file)):
    if i % num_per_drill_folder == 0:
	folder_index += 1
	folder = Path.cwd() / f"drill_{folder_index}"
	if not folder.exists():
	    folder.mkdir()
    with open(folder / f"{language_2}_drill_{i}.org", "w") as f:
	for j, l1_sentences in enumerate(l1_keys[r: r+num_per_drill_file]):
	    f.write(f"* Question {j} :drill:\n")
	    f.write("\t:PROPERTIES:\n\t:DRILL_CARD_TYPE: twosided\n\t:END:\n\n")
	    f.write(f"** {language_1}\n\n")
	    l2_sentences = set()
	    for l1_sentence in l1_sentences:
		f.write(f"{l1_sentence}\n")
		l2_sentences = l2_sentences.union(l1_to_l2[l1_sentence])
	    f.write("\n")
	    f.write("** {language_2}\n\n")
	    for l2_sentence in l2_sentences:
		f.write(f"{l2_sentence}\n")
	    f.write("\n")