0000000000000000000000000000000000000000 c23ec8364dd576ffebfb7c7ef68e512514c4b5d8 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1781779814 +0200	branch: Created from main
c23ec8364dd576ffebfb7c7ef68e512514c4b5d8 809fde9d9e3aa75a57dfcfc7d2fd02fd00caec31 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1781779840 +0200	commit: feat: Add script to download WURA isiXhosa corpus from Hugging Face
809fde9d9e3aa75a57dfcfc7d2fd02fd00caec31 e8779cc217166e95a061b895de79777a235153c0 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1781779858 +0200	commit: feat: Implement script to download and save WURA isiXhosa corpus from Hugging Face
e8779cc217166e95a061b895de79777a235153c0 220d96b84d45ea393dc19a2a01f8e9b793fcf3ba Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1781880650 +0200	commit: feat: Add script to download and save evaluation datasets from Hugging Face
220d96b84d45ea393dc19a2a01f8e9b793fcf3ba 8049c6f1d5995eb5392f7733085dba3ab4c60b45 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1781905143 +0200	commit: fix: Update .gitignore to reflect new dataset directory structure and modify logging in download_corpus.py
8049c6f1d5995eb5392f7733085dba3ab4c60b45 fbabfaf8835d0e34b32cd239395557d64dc52748 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1781910755 +0200	commit: feat: Add scripts for downloading WURA isiXhosa corpus and evaluation datasets
fbabfaf8835d0e34b32cd239395557d64dc52748 e6cf9ef56e635ad4871e2d45d992c48c2461cd5b Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1781992196 +0200	commit: feat: Modify download.sh for environment variable loading
e6cf9ef56e635ad4871e2d45d992c48c2461cd5b 0dcf97aad2afffa5bf08dd62948632228b2ae117 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1782073044 +0200	commit: feat: Implement checkpointing schedule for continued pretraining
0dcf97aad2afffa5bf08dd62948632228b2ae117 28cc8779c7c717e021651b3a449832b91578567a Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1782171114 +0200	commit: feat: Add model configuration files for nguni-xlmr, roberta, and xlmr
28cc8779c7c717e021651b3a449832b91578567a 50305523444a961e7429cd743ff7a242fcbcf5a9 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1782171159 +0200	commit: fix: Update docstrings to correct return statements in dataset loading functions
50305523444a961e7429cd743ff7a242fcbcf5a9 bf32ba97922959c2c612612056087f5f70c8c07b Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1782333888 +0200	commit: chore: Updated download.sh log output path
bf32ba97922959c2c612612056087f5f70c8c07b fda043cf290e587b843076520a39f5971a3f214f Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1782419850 +0200	commit: feat: Add preprocessing script for tokenizing and chunking WURA corpus
fda043cf290e587b843076520a39f5971a3f214f c6c111394e696d8148a519a465836ad4bd78cced Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1782420866 +0200	commit: feat: Add SLURM batch script for preprocessing dataset splits
c6c111394e696d8148a519a465836ad4bd78cced 278ee5de81ac498c7412ffc6a75dde8cdd3eca5d Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1782420913 +0200	commit: feat: Implement ModelConfig class for continued pretraining configuration
278ee5de81ac498c7412ffc6a75dde8cdd3eca5d 7d73ac4590483a0d06f73c43e205a9346fafd825 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1782420918 +0200	commit: feat: Add pretraining script for continued pretraining of encoder-only models
7d73ac4590483a0d06f73c43e205a9346fafd825 dccb9ba7ac4bff047fafaa7ee93c28f84965d3bf Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1782421002 +0200	commit: fix: Update total_steps in xlmr.yaml for training configuration
dccb9ba7ac4bff047fafaa7ee93c28f84965d3bf 8a75fb426acdf6e66fd3e6277439af1c13d0f752 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1782422786 +0200	commit: feat: Update project structure and configuration
8a75fb426acdf6e66fd3e6277439af1c13d0f752 6faa5ac7c72cba4821be0a05e5594890cafb490b Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1782423601 +0200	commit: fix: Correct config path in preprocess and pretrain scripts
6faa5ac7c72cba4821be0a05e5594890cafb490b d3ba339f85db217da15cd15a22ff877584c0cfa4 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1782424430 +0200	commit: fix: Adjust logging verbosity in tokenize_and_chunk function
d3ba339f85db217da15cd15a22ff877584c0cfa4 50e0f1e54c7a36e89e4e757516809e8157e7bab1 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1782427187 +0200	commit: fix: Change configuration directory name
50e0f1e54c7a36e89e4e757516809e8157e7bab1 e41269ad846c343ce29466308742e1e780ec1c18 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1782427797 +0200	commit: fix: Update job names and add git pull commands in script files
e41269ad846c343ce29466308742e1e780ec1c18 77d360aabe3db7b0730d34c326ae5791a2537e00 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1782429677 +0200	commit: fix: Add GPU availability checks and update training arguments accordingly
77d360aabe3db7b0730d34c326ae5791a2537e00 c8de45bf590fd1707425c5b61575858f19ff6ffd Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1782431704 +0200	commit: fix: Update output directories in model configuration files
c8de45bf590fd1707425c5b61575858f19ff6ffd 1f8a4770cac2b4e44a975eddedc573da7646cb3b Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1782432043 +0200	commit: fix: Update output directories in model configuration
1f8a4770cac2b4e44a975eddedc573da7646cb3b 5dde7456a63f7c42ea0f79dbe3fec2e895ef158c Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1782432062 +0200	commit: fix: Update HPC paths and HuggingFace cache configuration in scripts
5dde7456a63f7c42ea0f79dbe3fec2e895ef158c 8ed44940d07edf5868be8aae1e779180614fd1e5 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1782465976 +0200	commit: fix: Update batch size in model configuration from 80 to 4
8ed44940d07edf5868be8aae1e779180614fd1e5 801767ebceef19538402470ea28b5b98ecc7b807 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1782467678 +0200	commit: fix: Update output directories and add logging steps in model configurations
801767ebceef19538402470ea28b5b98ecc7b807 b8f513139a9b17618ba5a11ba10fc1ac38e5880f Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1782814707 +0200	commit: fix: Update .gitignore to include HuggingFace and Weights and Biases cache directories
b8f513139a9b17618ba5a11ba10fc1ac38e5880f 7136f42c0278b4eea057e7edcf45f451df929404 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1782820332 +0200	commit: fix: Update dataset output directories and add new evaluation task configurations
7136f42c0278b4eea057e7edcf45f451df929404 a5b8603a83291e981d53318434af9f10a8348e69 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1782855098 +0200	commit: fix: Add task_type to NER, NTC, and POS configuration files
a5b8603a83291e981d53318434af9f10a8348e69 4864a114c9036dfc28f3e44c6f08de6aa7a59a9d Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1782855519 +0200	commit: feat: Add configuration for downstream evaluation tasks
4864a114c9036dfc28f3e44c6f08de6aa7a59a9d c688f2f2553420cba9d11f4f966444f6bbc5c90f Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1782856344 +0200	commit: chore: Update preprocess.py to preprocess_corpus.py and all references
c688f2f2553420cba9d11f4f966444f6bbc5c90f 43a764d8911b9208ae59198275e629bf0bbf09c1 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1782909205 +0200	commit: feat: Add evaluation dataset preprocessing script for downstream fine-tuning
43a764d8911b9208ae59198275e629bf0bbf09c1 82b3ffc038d4259ddf2927edfb3a14062e3767cc Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1782909681 +0200	commit: fix: Update parameter description for num_proc in tokenize_and_chunk function
82b3ffc038d4259ddf2927edfb3a14062e3767cc 2cf233ae72e06da552feb49b8c20d26c7ec55cfa Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1782922647 +0200	commit: refactor: Standardize argument names
2cf233ae72e06da552feb49b8c20d26c7ec55cfa f3c69a1a1c98a194d9de5a6ad993f888b0e418d6 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1782922815 +0200	commit: feat: Add script for preprocessing evaluation datasets
f3c69a1a1c98a194d9de5a6ad993f888b0e418d6 544044f85f175aa5f7507556bd314cf65b49bab4 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1782923318 +0200	commit: feat: Update pretraining script for GPU compatibility
544044f85f175aa5f7507556bd314cf65b49bab4 2050263ddccb6ec3269767db947bb18ceb2fda1f Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1782924118 +0200	commit: fix: Correct argument name for model configuration in main function
2050263ddccb6ec3269767db947bb18ceb2fda1f 4dacb14037c8cc0c4d965d1d63afa6123f6634e1 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1782941383 +0200	commit: fix: Update git log command to show only the latest commit in preprocessing scripts
4dacb14037c8cc0c4d965d1d63afa6123f6634e1 006e57db815c4eaace3e881e7cfc6da7ec49454a Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1782942062 +0200	commit: fix: Correct argument name for model configuration in main function
006e57db815c4eaace3e881e7cfc6da7ec49454a 6d3ae4ed28ec918e58c1689d6a41069bdbff3b5f Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1783284466 +0200	commit: fix: Update evaluation configuration in NER, NTC, and POS YAML files
6d3ae4ed28ec918e58c1689d6a41069bdbff3b5f 6a438535f19f40d501d85d6d1fbe50a982e0ce19 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1783284511 +0200	commit: fix: Correct git log command in download script and update help text in evaluation data downloader
6a438535f19f40d501d85d6d1fbe50a982e0ce19 6ea0fc4070860ab34697ae4dceed07c7f2526dd4 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1783284563 +0200	commit: fix: Update evaluation configuration references in preprocess_eval.py
6ea0fc4070860ab34697ae4dceed07c7f2526dd4 6d50c06f35ac6ac76c768e14a0f6a330cdfe2900 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1783284576 +0200	commit: feat: Add finetune.py script for fine-tuning and evaluating CPT checkpoints on downstream tasks
6d50c06f35ac6ac76c768e14a0f6a330cdfe2900 fa10e09f0dab8f0264aab5722ae70f9b6a5fab9a Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1783463716 +0200	commit: fix: Update model_name_or_path to use large variants for Roberta and XLM-Roberta
fa10e09f0dab8f0264aab5722ae70f9b6a5fab9a badf35dda626b33c53f3263c13f13613e62a7a62 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1783465120 +0200	commit: feat: Add finetune.sh script for fine-tuning and evaluating models
badf35dda626b33c53f3263c13f13613e62a7a62 0d2e5e52246caf13755bd8a61e4ced397d0e2a63 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1783465137 +0200	commit: feat: Add reproducibility settings for training in finetune.py and pretrain.py
0d2e5e52246caf13755bd8a61e4ced397d0e2a63 3439a69c825223c055e77f912a45d7905a75114d Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1783466196 +0200	commit: fix: Update evaluation configuration paths in finetune.sh and preprocess_eval.sh
3439a69c825223c055e77f912a45d7905a75114d f5615aafd16e49110209d27a8b5aea027d2076ca Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1783467316 +0200	commit: fix: Update script paths in finetune.sh to point to the correct evaluation directory
f5615aafd16e49110209d27a8b5aea027d2076ca bb45bca50cd956d8f482e1e481885d4df04bf423 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1783499570 +0200	commit: fix: Update model_name_or_path in xlmr.yaml and adjust checkpoint/output paths in finetune.sh
bb45bca50cd956d8f482e1e481885d4df04bf423 e3f504c9ab12f41cbca8bee09e0653da55457dc9 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1783500093 +0200	commit: fix: Ensure metric is correctly loaded as EvalMetric in EvalConfig
e3f504c9ab12f41cbca8bee09e0653da55457dc9 7c2bcd48d1de6bb48417b09bd4bf6e26ef8541a3 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1783713822 +0200	commit: fix: Update model configurations for nguni-xlmr, roberta, and xlmr with new parameters and paths
7c2bcd48d1de6bb48417b09bd4bf6e26ef8541a3 e3a19f46304060d9c68891abc372bff54bb53afd Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1783713846 +0200	commit: fix: Update ModelConfig to include new training parameters and adjust pretraining script for resumption checkpoints
e3a19f46304060d9c68891abc372bff54bb53afd 7c51a8c56c3685ffe9a4a35713b02d48d42012e5 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1783714739 +0200	commit: fix: Refactor pretraining script to support multiple models and dynamic language selection
7c51a8c56c3685ffe9a4a35713b02d48d42012e5 eff3729da9a20b9b1a2da36d4071f569dd23e9e9 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1783759250 +0200	commit: fix: Adjust preprocessing and pretraining scripts to support dynamic model selection and additional parameters
eff3729da9a20b9b1a2da36d4071f569dd23e9e9 6d5c0d42d7f7da49c652935c0a4822946f4eaacd Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1783782350 +0200	commit: fix: Update scripts to use raw datasets and adjust evaluation parameters for fine-tuning
6d5c0d42d7f7da49c652935c0a4822946f4eaacd ad37d95141937f936a9e717babee78861a87acde Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1783793166 +0200	commit: fix: Update dataset paths in evaluation configurations to use raw datasets
ad37d95141937f936a9e717babee78861a87acde 299cdb96a07d38d2911c9862507949db194bbc5f Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1784061126 +0200	commit: fix: Update training configurations and scripts to support validation corpus and dynamic evaluation parameters
299cdb96a07d38d2911c9862507949db194bbc5f fccdf5609c3b3f4acf6608ab425a83b2d513c0ae Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1784104399 +0200	commit: fix: Update batch size and gradient accumulation steps in model configurations
fccdf5609c3b3f4acf6608ab425a83b2d513c0ae 95d608841f942a3d76164620b27371e1e6559532 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1784109708 +0200	commit: fix: Update training configurations to increase total steps, evaluation steps, and save steps
95d608841f942a3d76164620b27371e1e6559532 43c5d26ecde9fee0e5c36731915f3b11d9fb0f8a Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1784314031 +0200	commit: fix: Update checkpoint and output directories in finetune script for model-large
43c5d26ecde9fee0e5c36731915f3b11d9fb0f8a f2f515480e2e885f24183a95e29da86f0132ad7c Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1784318216 +0200	commit: fix: Evaluation metrics with per-class scores and update Weights and Biases configuration
f2f515480e2e885f24183a95e29da86f0132ad7c 3d72eecae4483699944ccea6b572e8b1ffd2a153 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1784318797 +0200	commit: fix: Adjust CPU allocation in finetune script
3d72eecae4483699944ccea6b572e8b1ffd2a153 dc073009e23dc86fade0c0b3775ce043953296ce Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1784369596 +0200	commit: fix: Add optional W&B project configuration to evaluation scripts
dc073009e23dc86fade0c0b3775ce043953296ce 3cbf39fa6e85d8cd0ef5d07c76cd5c85f53069d0 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1784369605 +0200	commit: feat: Add plotting scripts for learning dynamics visualisation
3cbf39fa6e85d8cd0ef5d07c76cd5c85f53069d0 25662dc39d5d412f518adbb5ed4caa8ddbbac421 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1784536268 +0200	commit: fix: Update dataset paths in .gitignore and correct job name in plot script
25662dc39d5d412f518adbb5ed4caa8ddbbac421 5e12ba90a6a5656a36e435537e6fc4d43ba2969f Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1784543444 +0200	commit: feat: Add early stopping configuration and W&B run ID support for pretraining scripts
5e12ba90a6a5656a36e435537e6fc4d43ba2969f 0b00d64aa7bdaf61c48d7f7b692bf97ef36bfb43 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1784550890 +0200	commit: fix: Update training parameters and W&B run names in model configuration files
0b00d64aa7bdaf61c48d7f7b692bf97ef36bfb43 c28645e0ea2022c371c0b40ee01869226a04de94 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1784627961 +0200	commit: refactor: Edit evaluation preprocessing and fine-tuning scripts
c28645e0ea2022c371c0b40ee01869226a04de94 4ed6eb4c3cfafb323c9173d532edb4b892750012 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1784636908 +0200	commit: feat: Add scripts for plotting CPT loss curves
4ed6eb4c3cfafb323c9173d532edb4b892750012 bfaa2c888c681a4b9bb238e6d983eeec6533823b Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1784711554 +0200	commit: refactor: Update plotting functions for training and validation loss curves
bfaa2c888c681a4b9bb238e6d983eeec6533823b af617029e2d8571c6e664ad85e9090c9d786e78a Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1784735823 +0200	commit: refactor: Simplify seed initialization and adjust step handling in loss plotting functions
af617029e2d8571c6e664ad85e9090c9d786e78a 57e52cbfa996947fbee5ff794c98e10b613f54b3 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1784794788 +0200	commit: feat: Add script for plotting fine-tuning loss curves and refactor result loading function
57e52cbfa996947fbee5ff794c98e10b613f54b3 afda5c7cc7be82120914dbd18e2915aee42a13c1 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1784795514 +0200	commit: fix: Add task argument to finetuning plotting
afda5c7cc7be82120914dbd18e2915aee42a13c1 5e88d424c35b681b0c33ba0417be7366b84033f5 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1784802206 +0200	commit: fix: Update epochs to 2 in finetuning configuration files and adjust SLURM job time
5e88d424c35b681b0c33ba0417be7366b84033f5 7c5add06344e00c36b5bd89bb6389881eddbd4a8 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1784929117 +0200	commit: fix: Update epochs to 10 in finetuning configuration files and adjust save strategies in finetune.py
7c5add06344e00c36b5bd89bb6389881eddbd4a8 b218ecb7d35e12299b00e8aaa6f50487ae2f2fd0 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1784960439 +0200	commit: fix: Update epochs to 2 in finetuning configuration files and adjust save strategies in finetune.py
b218ecb7d35e12299b00e8aaa6f50487ae2f2fd0 10f554c2bac8565c3c8a79182d32fa0c68a017d1 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1785104604 +0200	commit: feat: Enhance plotting functions with configurable step axis for improved visualization
10f554c2bac8565c3c8a79182d32fa0c68a017d1 31df67608af629e4b3342cff37677c1709ea8f89 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1785141842 +0200	commit: fix: Update evaluation metrics and increase epochs in finetuning configurations
31df67608af629e4b3342cff37677c1709ea8f89 8a9a2858937f9bbd234a7e9c34b7d5a85e21422a Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1785141866 +0200	commit: feat: Add label validation function and update evaluation metrics for fine-tuning
8a9a2858937f9bbd234a7e9c34b7d5a85e21422a b1067a9ac9ae81ab3c5e18d295c7917db5e714d8 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1785141890 +0200	commit: fix: Fixed plot dynamics functionality
b1067a9ac9ae81ab3c5e18d295c7917db5e714d8 6a97069d09f686659da96f41dd50ff52b69477f1 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1785141972 +0200	commit: fix: Fix step-0 overwrite bug
6a97069d09f686659da96f41dd50ff52b69477f1 b0bbbcb09a91a7566ee312d13c90d50303d6ff65 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1785142652 +0200	commit: fix: Updated seed values
b0bbbcb09a91a7566ee312d13c90d50303d6ff65 de869b7cb7cca6ca8cac1dbc4eb43976ab8fe27b Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1785226215 +0200	commit: refactor: Simplify plotting functions by removing standard deviation bands and updating axis configuration
de869b7cb7cca6ca8cac1dbc4eb43976ab8fe27b 35c8e769672ea27ac61bc4220edd06a237a7fd18 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1785230695 +0200	commit: refactor: Update plot formatting by removing log scale and fix axis labels
35c8e769672ea27ac61bc4220edd06a237a7fd18 8efbb7863557dd6c004ccd7b99327b9e80360fa1 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1785233649 +0200	commit: refactor: Adjust dynamics plots to the log scale.
8efbb7863557dd6c004ccd7b99327b9e80360fa1 32a13e3c091e8522ecbff0172ee4f754a1f13f5d Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1785316303 +0200	commit: refactor: Update learning rate and warmup configuration across finetuning scripts
32a13e3c091e8522ecbff0172ee4f754a1f13f5d 132152141dccc1bd5dc6429e8eaeddc6b79c1547 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1785407633 +0200	commit: refactor: Update symlog configuration for step axis in plotting functions
132152141dccc1bd5dc6429e8eaeddc6b79c1547 bea916cca741e00ee7ae0a3378a1eb35196f0860 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1785408622 +0200	commit: refactor: Remove symlog configuration and simplify step axis handling in plotting functions
bea916cca741e00ee7ae0a3378a1eb35196f0860 bb666d73b83f671037073f12edb3bef9dfe759a7 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1785421735 +0200	commit: refactor: Update epoch settings and add more metric calculations in finetuning scripts
bb666d73b83f671037073f12edb3bef9dfe759a7 b04d08c960c97748020c00e1705e0c92b46723be Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1785422066 +0200	commit: refactor: Update wandb_run_name for nguni-xlmr, roberta, and xlmr configurations
b04d08c960c97748020c00e1705e0c92b46723be f49040ff1f689ba9367c4a84a55fcd1d317f3389 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1785445411 +0200	commit: chore: Update download_corpus.py to download_wura.py
f49040ff1f689ba9367c4a84a55fcd1d317f3389 5ad8142e59bb6606019c867b348b3f6d5d4cb8d0 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1785483031 +0200	commit: feat: Add FLORES-200 download functionality
5ad8142e59bb6606019c867b348b3f6d5d4cb8d0 51f25b83f4ebc85e131a89d74b0f19ccbc5241a8 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1785483741 +0200	commit: fix: Update WANDB configs
51f25b83f4ebc85e131a89d74b0f19ccbc5241a8 48c94683b0317aea301862b55aaa00dd43b72a61 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1785491597 +0200	commit: refactor: Update W&B run names for models to include step count
48c94683b0317aea301862b55aaa00dd43b72a61 933c347d33fc131b981e8f09ac4f54338cca1003 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1785498242 +0200	commit: feat: Add perplexity computation script for CPT checkpoints on FLORES-200
933c347d33fc131b981e8f09ac4f54338cca1003 8a89e7ebe63287e984a3d801d3cd6916fde841b4 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1785534152 +0200	commit: feat: Add script for plotting pseudo-perplexity dynamics across CPT checkpoints
8a89e7ebe63287e984a3d801d3cd6916fde841b4 c0995e52ba025a256ac6169f7498d264a5eee0b9 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1785599585 +0200	commit: refactor: Improve logit computation and visualisation in perplexity scripts
c0995e52ba025a256ac6169f7498d264a5eee0b9 0b711e85bb15c66b2dd0c9cd461671cfb4609bb2 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1785604756 +0200	commit: feat: Edit plotting scripts to support multiple models
0b711e85bb15c66b2dd0c9cd461671cfb4609bb2 079271849248df72de895c559f9092b88d111d57 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1785604765 +0200	commit: refactor: Simplify comment for all-models overview in plot_perplexity.py
079271849248df72de895c559f9092b88d111d57 3e4c9f0de5e4bc5cdd6ab71ac3b9c78b232cc6b2 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1785760622 +0200	commit: feat: Organize output directories for plotting scripts and edit perplexity computation
3e4c9f0de5e4bc5cdd6ab71ac3b9c78b232cc6b2 4ef57840ba7d19f12723acce072c1fbedf113e21 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1786007999 +0200	commit: chore: Edit configs
4ef57840ba7d19f12723acce072c1fbedf113e21 3f538573b3f840bc47068c60c54a45c65cc5f755 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1786048803 +0200	commit: feat: Add model configuration for AfriBERTa
3f538573b3f840bc47068c60c54a45c65cc5f755 82d1ac376c0b0c7f19a7787630a20a3063539656 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1786051353 +0200	commit: feat: Update dataset paths to scratch storage
82d1ac376c0b0c7f19a7787630a20a3063539656 3ac2fd619a516eb0cb706bf04313792f7272fb10 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1786052756 +0200	commit: feat: Remove dataset_path from evaluation config files and update preprocessing scripts to accept input directory as argument
3ac2fd619a516eb0cb706bf04313792f7272fb10 f2f9d6b0ef20a2119c10d2525761546ac90dbb66 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1786116318 +0200	commit: feat: Update learning rate in AfriBERTa model configuration
f2f9d6b0ef20a2119c10d2525761546ac90dbb66 9738e6835a9dfb13ec857ca3d516acc81eac3774 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1786203297 +0200	commit: feat: Add alignment and embedding scripts for cross-lingual evaluation; update download scripts for FLORES-200 datasets
9738e6835a9dfb13ec857ca3d516acc81eac3774 c0b494ea59d559737bba41688d89501716f300e2 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1786313044 +0200	commit: feat: Add scripts for plotting cross-lingual alignment dynamics across models
c0b494ea59d559737bba41688d89501716f300e2 4098681c2b02f79068999b8b58f4f535567ead3e Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1786353382 +0200	commit: feat: Add top-1 retrieval metric, change to using final-layer hidden states
4098681c2b02f79068999b8b58f4f535567ead3e 4bf067135225e881cd10ec91f6436a3d8841173b Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1786355482 +0200	commit: feat: Add functions to plot cosine gap deltas and P@1 accuracy for model alignment
4bf067135225e881cd10ec91f6436a3d8841173b 23559c8cb522a4a02d5760445da428d2b0e7cb42 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1786486795 +0200	commit: feat: Add configuration files for ntc_xho and ntc_zul tasks and fine-tuning settings
23559c8cb522a4a02d5760445da428d2b0e7cb42 c6c251744903cb2d3ca5ffb2f5b23874e46e5b00 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1786519206 +0200	commit: feat: Add t-SNE plotting scripts
c6c251744903cb2d3ca5ffb2f5b23874e46e5b00 bc69e39db1e7000c6bf1d976a2808da2f10345bd Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1786520796 +0200	commit: feat: Update scripts to support isiZulu
bc69e39db1e7000c6bf1d976a2808da2f10345bd 99d2a0283e5dff7cd7a6b30cbe7fa4b58822fc06 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1786520822 +0200	commit: feat: Update Python scripts to support isiZulu
99d2a0283e5dff7cd7a6b30cbe7fa4b58822fc06 0d35a2f3a3e824b0d46519fc237a4b57778a8dfd Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1786565937 +0200	commit: feat: Implement IsoScore computation
0d35a2f3a3e824b0d46519fc237a4b57778a8dfd c39a5f70ed522ca65284e670c40132a295a84b65 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1786696718 +0200	commit: fix: ANTC download error
c39a5f70ed522ca65284e670c40132a295a84b65 7f3f132fc876928b29a292c582412c8b8fccd119 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1786711366 +0200	commit: feat: Add layer-wise evaluation and plotting scripts for cross-lingual alignment
7f3f132fc876928b29a292c582412c8b8fccd119 2e7f34ab10c8e2a916621b4b8975bab094e53195 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1786778972 +0200	commit: feat: Update .gitignore and refactor plotting scripts
2e7f34ab10c8e2a916621b4b8975bab094e53195 7ee85b7cb6ae62dabfd3b584be5bd7a9ba3e6389 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1786960199 +0200	commit: feat: Add scienceplots dependency
7ee85b7cb6ae62dabfd3b584be5bd7a9ba3e6389 55eaf9f645f3ffab0f4b864c91dc0669c7e58d6e Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1786960698 +0200	commit: fix: Update CPT plotting bash script
55eaf9f645f3ffab0f4b864c91dc0669c7e58d6e d799c4d3093c7ee8d348cfa18f28402f57e1b868 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1786961492 +0200	commit: fix: Update color palette and line width in matplotlib styling
d799c4d3093c7ee8d348cfa18f28402f57e1b868 497e38f689d74987fbc4925c2ac11dd66e6f6369 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1786962619 +0200	commit: fix: Axis scaling issue
497e38f689d74987fbc4925c2ac11dd66e6f6369 d5e05a0109a12bc8a4428808076d539053305064 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1786971039 +0200	commit: chore: Adjust resuls plotting
d5e05a0109a12bc8a4428808076d539053305064 7e996b883a9e2cbc3d8bcdc88ddcd818ba785571 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1786971952 +0200	commit: chore: Update colour pallete for POS tagging dynamics
7e996b883a9e2cbc3d8bcdc88ddcd818ba785571 9b2365a55fe3c4df5670fc940c978f2ece7e1c5f Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1787056734 +0200	commit: fix: Refactor plotting scripts alignment
9b2365a55fe3c4df5670fc940c978f2ece7e1c5f 89ac99416df71b718ed64b3ce85782cf53036f62 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1787169515 +0200	commit: feat: Add scripts for pushing CPT checkpoints to Hugging Face Hub
89ac99416df71b718ed64b3ce85782cf53036f62 e3fa4160e7c8577a64a3048354a69c372c70460e Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1788134608 +0200	commit: chore: Improved plotting functionality
e3fa4160e7c8577a64a3048354a69c372c70460e 0728f97e3cde3b25a334d1deea778096f93a1768 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1788161577 +0200	commit: fix: Fix plotting bugs
0728f97e3cde3b25a334d1deea778096f93a1768 b2d768d0dd8a70e711d8054774fa38e4fef69130 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1788163955 +0200	commit: feat: Add class_colours function for dynamic label coloring in plots
b2d768d0dd8a70e711d8054774fa38e4fef69130 b6fb0094604fb35cac5a8c9f2e2f7f70029f516b Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1788165676 +0200	commit: fix: Debugged plotting files.
b6fb0094604fb35cac5a8c9f2e2f7f70029f516b 69b991981d4b93ad4394fff2a25b1d41f1e21f8c Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1789296088 +0200	commit: feat: Add accuracy metrics aggregation in step results
69b991981d4b93ad4394fff2a25b1d41f1e21f8c 45dc290528b3153a4621b70de187e3b51d318f44 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1789993692 +0200	commit: refactor: Refactored configuration code and added a README for the directory.
45dc290528b3153a4621b70de187e3b51d318f44 50102361c73a0b5e6d64df505a1f142ed1ab967b Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1789995792 +0200	commit: refactor: Update data downloading and preprocessing scripts
50102361c73a0b5e6d64df505a1f142ed1ab967b e0d446a0d80d7641c8a2ab3f849fb3b3f0d99042 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1790010877 +0200	commit: Refactor - Remove perplexity scripts and update geometry scripts
e0d446a0d80d7641c8a2ab3f849fb3b3f0d99042 380e848b7fa3b70d3d3448362bb1d166c00224a4 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1790011066 +0200	commit: refactor: Adjust formatting in compute_layerwise_alignment function definition
380e848b7fa3b70d3d3448362bb1d166c00224a4 10bc095e7b470a6f53fc46c924a700c649a159ad Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1790011290 +0200	commit: refactor: Remove redundant comments
10bc095e7b470a6f53fc46c924a700c649a159ad 52fbe5ba7d3b080456e3c91aa64320390a8ec08d Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1790011298 +0200	commit: refactor: Update .gitignore to include results directory and MacOS .DS_Store file
52fbe5ba7d3b080456e3c91aa64320390a8ec08d 31127f0d95b97e9021d49a0334e6c3f603b6811c Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1790012015 +0200	commit: refactor: Remove push_checkpoints script and associated functionality
31127f0d95b97e9021d49a0334e6c3f603b6811c 944425c6ecc0e16ea182c0b3cb126bb76ceca63d Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1790014464 +0200	commit: Refactor: Isolate checkpoint extraction and update finetuning scripts
944425c6ecc0e16ea182c0b3cb126bb76ceca63d 8234ee714ee5ec8688c09ba5e54c01227532b960 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1790017023 +0200	commit: Refactor: Update pretraining code to improve logging and documentation
8234ee714ee5ec8688c09ba5e54c01227532b960 9bfff45b230a856530e20b03986459b96bb6ce79 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1790021473 +0200	commit: refactor: Refactor visualisation scripts and remove unused visualisations
9bfff45b230a856530e20b03986459b96bb6ce79 20702aa327e6bcc5cf2cd8335f6380f83fdcf104 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1790021485 +0200	commit: refactor: Update tokenizer function signatures to include return types
20702aa327e6bcc5cf2cd8335f6380f83fdcf104 2f0dff87155d66c54c57130b2d15a6e1594397a2 Siyabonga Madondo <MDNSIY014@myuct.ac.za> 1790025639 +0200	commit: docs: Update README files to enhance project documentation and clarify usage instructions
