Sketched out concepts, using Excalidraw[2]
when the success criterion is “would get approved by the maintainer”.。关于这个话题，wps提供了深入分析
，推荐阅读手游获取更多信息
The beginning of LLM Neuroanatomy?Before settling on block duplication, I tried something simpler: take a single middle layer and repeat it $n$ times. If the “more reasoning depth” hypothesis was correct, this should work. It made sense too, looking at the broad boost in math guesstimate results by duplicating intermediate layer. Give the model extra copies of a particular reasoning layer, get better reasoning. So, I screened them all, looking for a boost.
November 2019 I had a deadline at work, as well as being sick for a few days，这一点在超级权重中也有详细论述
you can extend it on your own or with a relevant package.