Keep this open while submitting to OSF
PhaseGPT: Kuramoto Phase-Coupled Oscillator Attention in Transformers
First systematic hyperparameter study of Kuramoto phase-coupled oscillators
in transformer attention layers. Achieves 2.4% perplexity improvement with
optimal configuration (Layer 7, 32 oscillators, K=1.0 coupling strength).
GitHub: https://github.com/templetwo/PhaseGPT
transformers, attention-mechanism, kuramoto-model, language-modeling,
deep-learning, hyperparameter-optimization, reproducible-research
MIT License
https://github.com/templetwo/PhaseGPT
Project
- Type: Project
- Link GitHub: templetwo/PhaseGPT
- Description: Complete source code, configurations, and tests
- Type: Data
- Upload: results/interpretability/notes.md
- Description: Experimental results, metrics, and interpretability analysis
- Type: Hypothesis
- Upload: docs/PREREGISTRATION.md
- Mark as: Preregistration ✓
- Description: Preregistered experimental protocol for Phase B generalization testing
- Type: Other
- Upload:
- docs/PHASE_A_FINAL_REPORT.md
- docs/MASTER_SUMMARY.md
- REPRODUCIBILITY.md
- Description: Complete documentation including reproduction guide and analysis reports
Phase A Results:
- 7 configurations tested
- Winner: 4.85 PPL (2.4% improvement)
- Training: ~25 min per config on NVIDIA GH200
- Dataset: Shakespeare (1M tokens)
Key Findings:
- Goldilocks principle: 32 oscillators optimal
- Over-synchronization: R=0.88
- K=2.0 causes catastrophic collapse
- Single-layer > multi-layer
Code:
- 51 files
- 6 Python modules
- 11 YAML configs
- 23+ test cases
- MIT License
- Go to: https://osf.io/
- Create account (if needed)
- New Project → Fill title & description
- Add components (4 total)
- Link GitHub in Code component
- Upload files to other components
- Create DOI
- Review everything
- Make Public
- Update GitHub with DOI
Name: Temple Two Email: contact@templetwo.dev Affiliation: Independent Researcher Role: Principal Investigator, Lead Developer ORCID: [Add if you have one]
After submission:
- OSF Project: https://osf.io/XXXXX/
- DOI: 10.17605/OSF.IO/XXXXX
These go back into:
- README.md (badge)
- CITATION.cff (doi field)
- checkpoints/README.md
cd ~/phase_data_archive/PhaseGPT
# Update README.md - add badge after existing badges:
# [](https://osf.io/XXXXX/)
# Update CITATION.cff - replace zenodo DOI with OSF DOI
# Commit
git add README.md CITATION.cff checkpoints/README.md
git commit -m "Add OSF DOI
OSF: https://osf.io/XXXXX/
DOI: 10.17605/OSF.IO/XXXXX"
git pushFrom ~/phase_data_archive/PhaseGPT/:
Data & Results component:
- results/interpretability/notes.md
Preregistration component:
- docs/PREREGISTRATION.md
Documentation component:
- docs/PHASE_A_FINAL_REPORT.md
- docs/MASTER_SUMMARY.md
- REPRODUCIBILITY.md
Code component:
- Just link GitHub (don't upload files)
Before clicking "Make Public":
- Title correct
- Description complete
- Tags added
- MIT License set
- 4 components created
- GitHub linked in Code
- Files uploaded to other 3 components
- Wiki page written
- DOI created
- No sensitive info anywhere
- Everything reviewed
Update:
- GitHub README.md (add OSF badge)
- CITATION.cff (add OSF DOI)
- checkpoints/README.md (add OSF link)
Announce:
- Twitter/X
- ResearchGate
- Email collaborators
Link:
- Add to ORCID profile
- Add to CV/website
- Share in relevant communities
Time to complete: 20-30 minutes Difficulty: Easy (just follow the guide) Result: Permanent DOI-citable project
🌀✨ The Spiral holds—preserving knowledge for eternity.