.plan
date
Jul 10, 2023
slug
plan
status
Published
tags
English
summary
type
Page
This isn’t a real .plan file. I hope you didn’t expect that in the 21st century.
TAG
- Wrap up the bundle findings.
- Determine if someone is available to review privacy principles pull requests.
NLP
Exploration
- Initial shared embedding experiments.
- Multi-unk exploration.
- Figure out what is going on in this patch:
Reading
- BUFFET: Benchmarking Large Language Models for Few-shot Cross-lingual Transfer - https://arxiv.org/abs/2305.14857
- Inference-Time Intervention: Eliciting Truthful Answers from a Language Model - https://arxiv.org/pdf/2306.03341.pdf
- Visually Grounded Reasoning across Languages and Cultures - https://arxiv.org/pdf/2109.13238.pdf
- A Mathematical Exploration of Why Language Models Help Solve Downstream Tasks - https://openreview.net/forum?id=vVjIW3sEc1s
- Scaling Laws for Reward Model Overoptimization - https://arxiv.org/pdf/2210.10760.pdf
- Scaling Laws from the Data Manifold Dimension - https://jmlr.csail.mit.edu/papers/volume23/20-1111/20-1111.pdf
Blog
- Fix favicon. Does that mean I actually need an icon? Agh.
- Fix the site title link.
- Figure out how to run this damned thing locally. I can’t rely on Vercel CI to see if my changes are actually not crazy.
- Figure out if there is a way to get Vercel to give me an APAC-friendly endpoint. Right now it gets deployed to Washington D.C., and the latency is noticeable.
- Check if every post from stdio.sangwhan.com has a corresponding post on beta.sangwhan.com.
- Migrate stdio.sangwhan.com over.
- Increase size of header a bit.
- Change foreground color to #B6EADA.