Prerequesties

Code download the Knesset (Israel parlament) protocols. Full explanation of Knesset ODATA system can be found here https://main.knesset.gov.il/activity/info/pages/databases.aspx Code download 3 main sources from Knesset:

Documents are stored in original format and extracted text in .txt files

Usage

DownloadKnesetCorpus class download all files from all sources.
CountFilesNContent class count files per Knesset, per file format, and number of files, words & volume per source.

Name		Name	Last commit message	Last commit date
Latest commit History 42 Commits
KNS_DocumentBill_docs		KNS_DocumentBill_docs
KNS_DocumentBill_extracted_texts		KNS_DocumentBill_extracted_texts
KNS_DocumentCommitteeSession_docs		KNS_DocumentCommitteeSession_docs
KNS_DocumentCommitteeSession_extracted_texts		KNS_DocumentCommitteeSession_extracted_texts
KNS_DocumentPlenumSession_docs		KNS_DocumentPlenumSession_docs
KNS_DocumentPlenumSession_extracted_texts		KNS_DocumentPlenumSession_extracted_texts
logs		logs
odata_jsons		odata_jsons
.gitignore		.gitignore
KNS_DocumentBill_docs_download_log.txt		KNS_DocumentBill_docs_download_log.txt
KNS_DocumentBill_summary_per_knesset.csv		KNS_DocumentBill_summary_per_knesset.csv
KNS_DocumentCommitteeSession_docs_download_log.txt		KNS_DocumentCommitteeSession_docs_download_log.txt
KNS_DocumentCommitteeSession_summary_per_knesset.csv		KNS_DocumentCommitteeSession_summary_per_knesset.csv
KNS_DocumentPlenumSession_docs_download_log.txt		KNS_DocumentPlenumSession_docs_download_log.txt
KNS_DocumentPlenumSession_summary_per_knesset.csv		KNS_DocumentPlenumSession_summary_per_knesset.csv
KnessetOdataManual.docx		KnessetOdataManual.docx
README.md		README.md
config.py		config.py
corrupted_docs_log.csv		corrupted_docs_log.csv
count_files_n_content.py		count_files_n_content.py
download_knesset_corpus.py		download_knesset_corpus.py
download_knesset_metadata_tables.py		download_knesset_metadata_tables.py
errors_list.csv		errors_list.csv
logger_configurer.py		logger_configurer.py