Leo Gaohttps://leogao.dev/icon.png2022-02-19T05:52:00.889Zhttps://leogao.dev/Leo GaoHexoThoughts on the Alignment Implications of Scaling Language Modelshttps://leogao.dev/2021/06/02/Thoughts-on-the-Alignment-Implications-of-Scaling-Language-Models/2021-06-02T06:00:00.000Z2022-02-19T05:52:00.889Z
<p><img src="/images/scaling_alignment/title.jpg" alt></p>
<p>[Epistemic status: slightly rambly, mostly personal intuition and opinion
Building AGI Using Language Modelshttps://leogao.dev/2020/08/17/Building-AGI-Using-Language-Models/2020-08-17T06:00:00.000Z2022-02-19T05:52:00.889Z
<p><img src="/images/agi-lms/sunset1-glitch.png" alt></p>
<p><span class="smallcaps">Despite the buzz around GPT-3, it is, in and of
Why GPT-3 Mattershttps://leogao.dev/2020/05/29/GPT-3-A-Brief-Summary/2020-05-29T06:00:00.000Z2022-02-19T05:52:00.885Z
<p><img src="/images/gpt3/title.png" alt="Number of Parameters of GPT-3 compared to previous models. (<a
Breaking Down Reddit's Imposterhttps://leogao.dev/2020/04/01/Breaking-Down-Reddit-s-Imposter/2020-04-01T06:00:00.000Z2022-02-19T05:52:00.885Z
<p><img src="/images/imposter_reddit/ui3.png" alt="A view at the r/Imposter UI"></p>
<p><span class="smallcaps">The new Reddit April Fools
Multidisk Filesystems: A Comparisonhttps://leogao.dev/2020/01/31/Multidisk-Filesystems-A-Comparison/2020-01-31T07:00:00.000Z2022-02-19T05:52:00.885Z
<p><img src="/images/drives-3.png" alt></p>
<p><span class="smallcaps">With the death of <a
The Decade of Deep Learninghttps://leogao.dev/2019/12/31/The-Decade-of-Deep-Learning/2019-12-31T07:00:00.000Z2022-02-19T05:52:00.885Z
<div class="main-image" markdown="1">
<img src="/images/contour_really_small.png">
</div>
<p><span class="smallcaps">As the 2010’s draw to
Converting HuggingFace GPT-2 Models to Tensorflow 1.xhttps://leogao.dev/2019/11/09/Converting-HuggingFace-GPT2-Models-to-Tensorflow-1/2019-11-09T07:00:00.000Z2022-02-19T05:52:00.885Z
<p><span class="smallcaps"><a href="https://github.com/huggingface/transformers" target="_blank" rel="noopener">HuggingFace
The Difficulties of Text Generation using Autoregressive Language Models: A Brief Overviewhttps://leogao.dev/2019/10/27/The-Difficulties-of-Text-Generation-with-Autoregressive-Language-Models/2019-10-27T06:00:00.000Z2022-02-19T05:52:00.885Z
<p><img src="/images/geb_thumbnail_small.jpg" alt="Book: Gödel, Escher, Bach"></p>
<p><span class="smallcaps">Interest in text-generating
Hello, World!https://leogao.dev/2019/09/20/Hello-World/2019-09-20T06:00:00.000Z2022-02-19T05:52:00.885Z
<p>Hello,