Skip to content

Commit

Permalink
Site updated: 2025-01-17 21:35:30
Browse files Browse the repository at this point in the history
  • Loading branch information
@LegendLeoChen
LegendLeoChen committed Jan 17, 2025
1 parent 10e4b6c commit 6eed6f7
Show file tree
Hide file tree
Showing 8 changed files with 16,651 additions and 16,649 deletions.
7 changes: 4 additions & 3 deletions 2025/01/04/大模型及RAG架构的本地部署/index.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -93,7 +93,7 @@ <h1 class="article-title sea-center" style="border-left:0" itemprop="name">
<span class="post-meta-item-icon">
<i class="ri-quill-pen-line"></i>
<span class="post-meta-item-text"> 字数统计:</span>
<span class="post-count">1.8k</span>
<span class="post-count">1.9k</span>
</span>
</span>

Expand Down Expand Up @@ -154,8 +154,9 @@ <h2 id="知识库构建"><a href="#知识库构建" class="headerlink" title="
</ul>
<h1 id="🔥基本功能测试"><a href="#🔥基本功能测试" class="headerlink" title="🔥基本功能测试"></a>🔥基本功能测试</h1><p><img src="/2025/01/04/%E5%A4%A7%E6%A8%A1%E5%9E%8B%E5%8F%8ARAG%E6%9E%B6%E6%9E%84%E7%9A%84%E6%9C%AC%E5%9C%B0%E9%83%A8%E7%BD%B2/%E5%80%9F%E5%8A%A9%E7%9F%A5%E8%AF%86%E5%BA%93%E5%9B%9E%E7%AD%94.png" alt="借助知识库回答"></p>
<ul>
<li>之前在知识库传了一个论文，然后现在让它总结内容，可以看到能够正常返回和论文相关的内容。说明RAG的所有东西都是构建成功的。</li>
<li>之前在知识库传了一个论文，然后现在让它总结内容，如上图，可以看到能够正常返回和论文相关的内容。说明RAG的所有东西都是构建成功的。</li>
<li>不过总结的算不上全面，这些就和大量需要调整的内容和参数有关，包括但不限于之前提及的——LLM选择、LLM规模、嵌入模型选择、向量库选择、文本形式、嵌入token大小、相似度阈值等等。</li>
<li><strong>后续调试</strong>：之后我下载了32B参数的千问模型，变化不算大。然后文本嵌入时减小了文本的长度，从8k调到了4k，然后把word文档改为pdf后重新问该问题，发现能够相当完整地概括文章内容了，并且细问其中某个方面时也能够解答。说明嵌入后的向量不应该太长，模型可以适当增大，当然这会以时间开销为代价。</li>
</ul>
<h1 id="🔥API调试"><a href="#🔥API调试" class="headerlink" title="🔥API调试"></a>🔥API调试</h1><ul>
<li>本地部署大模型和RAG最重要的还是能不能用API直接访问，这样就可以把它集成到自己的网站、应用、程序中。无论是Ollama还是anythingllm都提供了API接口。<br><img src="/2025/01/04/%E5%A4%A7%E6%A8%A1%E5%9E%8B%E5%8F%8ARAG%E6%9E%B6%E6%9E%84%E7%9A%84%E6%9C%AC%E5%9C%B0%E9%83%A8%E7%BD%B2/%E5%88%9B%E5%BB%BAAPI_KEY.jpg" alt="创建API KEY"></li>
Expand Down Expand Up @@ -209,7 +210,7 @@ <h2 id="Python脚本调试"><a href="#Python脚本调试" class="headerlink" tit
<li>至此就实现了API调用功能。</li>
</ul>
<h1 id="🔥总结和展望"><a href="#🔥总结和展望" class="headerlink" title="🔥总结和展望"></a>🔥总结和展望</h1><ul>
<li>该方案基本功能都实现了，通过本次尝试，我对LLM部署和RAG框架构建有了初步的认识，市面上的免费方案确实已经足够方便又快捷。</li>
<li>该方案基本功能都实现了并做了初步的调试，通过本次尝试，我对LLM部署和RAG框架构建有了初步的认识，市面上的免费方案确实已经足够方便又快捷。</li>
<li>后续可以对各种参数和选择进行修改以调出更好的效果；或者尝试在树莓派等边缘设备的部署效果；以及尝试在具体大小项目中使用该LLM或者RAG。</li>
<li>当然，这个方案足够简便的同时自由度是有限的，要想有更细致的参数可调可以选择hugging face社区的一些方案来搭建RAG、微调模型，以进行更深入地学习。</li>
</ul>
Expand Down
125 changes: 61 additions & 64 deletions index.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -185,70 +185,6 @@ <h1 class="center-text glitch" data-text="LegendLeo Chen 的空间">LegendLeo Ch



<article
id="post-Hexo搭建"
class="article article-type-post"
itemscope
itemprop="blogPost"
data-scroll-reveal
>
<div class="article-inner">

<header class="article-header">

<h2 itemprop="name">
<a class="article-title" href="/2023/03/02/Hexo%E6%90%AD%E5%BB%BA/"
>Hexo搭建
<i class="article-topping">置顶</i>
</a>
</h2>



</header>

<div class="article-meta">
<a href="/2023/03/02/Hexo%E6%90%AD%E5%BB%BA/" class="article-date">
<time datetime="2023-03-02T04:54:21.000Z" itemprop="datePublished">2023-03-02</time>
</a>
<div class="article-category">
<a class="article-category-link" href="/categories/%E6%95%99%E7%A8%8B/">教程</a>
</div>

</div>

<div class="article-entry" itemprop="articleBody">

<h1 id="安装软件"><a href="#安装软件" class="headerlink" title="安装软件"></a>安装软件</h1><h2 id="安装git"><a href="#安装git" class="headerlink" title="安装git"></a>安装git</h2><blockquote>
<ul>
<li>官网下载git，确定好安装位置，无脑下一步即可。</li>
<li>完成后右键菜单将出现 <em>Git GUI</em> 和 <em>Git Bash</em> 两个新选项</li>
</ul>
</blockquote>
<a class="article-more-link" href="/2023/03/02/Hexo%E6%90%AD%E5%BB%BA/"
>阅读更多...</a
>

<!-- reward -->

</div>


<!-- copyright -->

<footer class="article-footer">

<ul class="article-tag-list" itemprop="keywords"><li class="article-tag-list-item"><a class="article-tag-list-link" href="/tags/Hexo/" rel="tag">Hexo</a></li></ul>

</footer>
</div>




</article>


<article
id="post-大模型及RAG架构的本地部署"
class="article article-type-post"
Expand Down Expand Up @@ -775,6 +711,67 @@ <h1 id="🔥前言"><a href="#🔥前言" class="headerlink" title="🔥前言">



</article>


<article
id="post-LeoCar：树莓派智能车——综合篇"
class="article article-type-post"
itemscope
itemprop="blogPost"
data-scroll-reveal
>
<div class="article-inner">

<header class="article-header">

<h2 itemprop="name">
<a class="article-title" href="/2023/12/29/LeoCar%EF%BC%9A%E6%A0%91%E8%8E%93%E6%B4%BE%E6%99%BA%E8%83%BD%E8%BD%A6%E2%80%94%E2%80%94%E7%BB%BC%E5%90%88%E7%AF%87/"
>LeoCar：树莓派智能车——综合篇</a>
</h2>



</header>

<div class="article-meta">
<a href="/2023/12/29/LeoCar%EF%BC%9A%E6%A0%91%E8%8E%93%E6%B4%BE%E6%99%BA%E8%83%BD%E8%BD%A6%E2%80%94%E2%80%94%E7%BB%BC%E5%90%88%E7%AF%87/" class="article-date">
<time datetime="2023-12-29T07:33:17.000Z" itemprop="datePublished">2023-12-29</time>
</a>
<div class="article-category">
<a class="article-category-link" href="/categories/%E5%89%8D%E7%AB%AF/">前端</a> / <a class="article-category-link" href="/categories/%E5%B5%8C%E5%85%A5%E5%BC%8F/">嵌入式</a> / <a class="article-category-link" href="/categories/%E7%BC%96%E7%A8%8B/">编程</a> / <a class="article-category-link" href="/categories/%E9%A1%B9%E7%9B%AE/">项目</a>
</div>

</div>

<div class="article-entry" itemprop="articleBody">

<ul>
<li>文章链接：<a href="/2023/12/10/LeoCar%EF%BC%9A%E6%A0%91%E8%8E%93%E6%B4%BE%E6%99%BA%E8%83%BD%E8%BD%A6%E2%80%94%E2%80%94%E7%BD%91%E7%BB%9C%E7%AF%87/" title="LeoCar：树莓派智能车——网络篇">网络篇</a>——&gt;<a href="/2023/12/21/LeoCar%EF%BC%9A%E6%A0%91%E8%8E%93%E6%B4%BE%E6%99%BA%E8%83%BD%E8%BD%A6%E2%80%94%E2%80%94%E7%94%B5%E6%8E%A7%E7%AF%87/" title="LeoCar：树莓派智能车——电控篇">电控篇</a>——&gt;<a href="/2023/12/29/LeoCar%EF%BC%9A%E6%A0%91%E8%8E%93%E6%B4%BE%E6%99%BA%E8%83%BD%E8%BD%A6%E2%80%94%E2%80%94%E7%BB%BC%E5%90%88%E7%AF%87/" title="LeoCar：树莓派智能车——综合篇">综合篇</a></li>
<li>项目链接：<a target="_blank" rel="noopener" href="https://github.com/LegendLeoChen/LeoCar">https://github.com/LegendLeoChen/LeoCar</a></li>
<li>上次实现小车结构和电路搭建，先使用ESP32实现对小车的控制，以及电源方案的验证。</li>
<li>本次使用树莓派完成对小车的控制，以及视觉算法的加入。</li></ul>
<a class="article-more-link" href="/2023/12/29/LeoCar%EF%BC%9A%E6%A0%91%E8%8E%93%E6%B4%BE%E6%99%BA%E8%83%BD%E8%BD%A6%E2%80%94%E2%80%94%E7%BB%BC%E5%90%88%E7%AF%87/"
>阅读更多...</a
>

<!-- reward -->

</div>


<!-- copyright -->

<footer class="article-footer">

<ul class="article-tag-list" itemprop="keywords"><li class="article-tag-list-item"><a class="article-tag-list-link" href="/tags/API/" rel="tag">API</a></li><li class="article-tag-list-item"><a class="article-tag-list-link" href="/tags/JavaScript/" rel="tag">JavaScript</a></li><li class="article-tag-list-item"><a class="article-tag-list-link" href="/tags/Python/" rel="tag">Python</a></li><li class="article-tag-list-item"><a class="article-tag-list-link" href="/tags/TB6612FNG/" rel="tag">TB6612FNG</a></li><li class="article-tag-list-item"><a class="article-tag-list-link" href="/tags/%E6%A0%91%E8%8E%93%E6%B4%BE/" rel="tag">树莓派</a></li></ul>

</footer>
</div>




</article>


Expand Down
118 changes: 57 additions & 61 deletions page/2/index.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -185,67 +185,6 @@ <h1 class="center-text glitch" data-text="LegendLeo Chen 的空间">LegendLeo Ch



<article
id="post-LeoCar：树莓派智能车——综合篇"
class="article article-type-post"
itemscope
itemprop="blogPost"
data-scroll-reveal
>
<div class="article-inner">

<header class="article-header">

<h2 itemprop="name">
<a class="article-title" href="/2023/12/29/LeoCar%EF%BC%9A%E6%A0%91%E8%8E%93%E6%B4%BE%E6%99%BA%E8%83%BD%E8%BD%A6%E2%80%94%E2%80%94%E7%BB%BC%E5%90%88%E7%AF%87/"
>LeoCar：树莓派智能车——综合篇</a>
</h2>



</header>

<div class="article-meta">
<a href="/2023/12/29/LeoCar%EF%BC%9A%E6%A0%91%E8%8E%93%E6%B4%BE%E6%99%BA%E8%83%BD%E8%BD%A6%E2%80%94%E2%80%94%E7%BB%BC%E5%90%88%E7%AF%87/" class="article-date">
<time datetime="2023-12-29T07:33:17.000Z" itemprop="datePublished">2023-12-29</time>
</a>
<div class="article-category">
<a class="article-category-link" href="/categories/%E5%89%8D%E7%AB%AF/">前端</a> / <a class="article-category-link" href="/categories/%E5%B5%8C%E5%85%A5%E5%BC%8F/">嵌入式</a> / <a class="article-category-link" href="/categories/%E7%BC%96%E7%A8%8B/">编程</a> / <a class="article-category-link" href="/categories/%E9%A1%B9%E7%9B%AE/">项目</a>
</div>

</div>

<div class="article-entry" itemprop="articleBody">

<ul>
<li>文章链接：<a href="/2023/12/10/LeoCar%EF%BC%9A%E6%A0%91%E8%8E%93%E6%B4%BE%E6%99%BA%E8%83%BD%E8%BD%A6%E2%80%94%E2%80%94%E7%BD%91%E7%BB%9C%E7%AF%87/" title="LeoCar：树莓派智能车——网络篇">网络篇</a>——&gt;<a href="/2023/12/21/LeoCar%EF%BC%9A%E6%A0%91%E8%8E%93%E6%B4%BE%E6%99%BA%E8%83%BD%E8%BD%A6%E2%80%94%E2%80%94%E7%94%B5%E6%8E%A7%E7%AF%87/" title="LeoCar：树莓派智能车——电控篇">电控篇</a>——&gt;<a href="/2023/12/29/LeoCar%EF%BC%9A%E6%A0%91%E8%8E%93%E6%B4%BE%E6%99%BA%E8%83%BD%E8%BD%A6%E2%80%94%E2%80%94%E7%BB%BC%E5%90%88%E7%AF%87/" title="LeoCar：树莓派智能车——综合篇">综合篇</a></li>
<li>项目链接：<a target="_blank" rel="noopener" href="https://github.com/LegendLeoChen/LeoCar">https://github.com/LegendLeoChen/LeoCar</a></li>
<li>上次实现小车结构和电路搭建，先使用ESP32实现对小车的控制，以及电源方案的验证。</li>
<li>本次使用树莓派完成对小车的控制，以及视觉算法的加入。</li></ul>
<a class="article-more-link" href="/2023/12/29/LeoCar%EF%BC%9A%E6%A0%91%E8%8E%93%E6%B4%BE%E6%99%BA%E8%83%BD%E8%BD%A6%E2%80%94%E2%80%94%E7%BB%BC%E5%90%88%E7%AF%87/"
>阅读更多...</a
>

<!-- reward -->

</div>


<!-- copyright -->

<footer class="article-footer">

<ul class="article-tag-list" itemprop="keywords"><li class="article-tag-list-item"><a class="article-tag-list-link" href="/tags/API/" rel="tag">API</a></li><li class="article-tag-list-item"><a class="article-tag-list-link" href="/tags/JavaScript/" rel="tag">JavaScript</a></li><li class="article-tag-list-item"><a class="article-tag-list-link" href="/tags/Python/" rel="tag">Python</a></li><li class="article-tag-list-item"><a class="article-tag-list-link" href="/tags/TB6612FNG/" rel="tag">TB6612FNG</a></li><li class="article-tag-list-item"><a class="article-tag-list-link" href="/tags/%E6%A0%91%E8%8E%93%E6%B4%BE/" rel="tag">树莓派</a></li></ul>

</footer>
</div>




</article>


<article
id="post-LeoCar：树莓派智能车——电控篇"
class="article article-type-post"
Expand Down Expand Up @@ -770,6 +709,63 @@ <h2 itemprop="name">



</article>


<article
id="post-PSIM反激变换器的EMI分析及优化"
class="article article-type-post"
itemscope
itemprop="blogPost"
data-scroll-reveal
>
<div class="article-inner">

<header class="article-header">

<h2 itemprop="name">
<a class="article-title" href="/2023/05/25/PSIM%E5%8F%8D%E6%BF%80%E5%8F%98%E6%8D%A2%E5%99%A8%E7%9A%84EMI%E5%88%86%E6%9E%90%E5%8F%8A%E4%BC%98%E5%8C%96/"
>PSIM反激变换器的EMI分析及优化</a>
</h2>



</header>

<div class="article-meta">
<a href="/2023/05/25/PSIM%E5%8F%8D%E6%BF%80%E5%8F%98%E6%8D%A2%E5%99%A8%E7%9A%84EMI%E5%88%86%E6%9E%90%E5%8F%8A%E4%BC%98%E5%8C%96/" class="article-date">
<time datetime="2023-05-25T05:16:28.000Z" itemprop="datePublished">2023-05-25</time>
</a>
<div class="article-category">
<a class="article-category-link" href="/categories/%E4%BB%BF%E7%9C%9F/">仿真</a> / <a class="article-category-link" href="/categories/%E7%A1%AC%E4%BB%B6/">硬件</a>
</div>

</div>

<div class="article-entry" itemprop="articleBody">

<p>使用PSIM进行反激式开关电源的EMI干扰分析与仿真，PSIM是一种电力电子专用的仿真软件，使用上手方便，操作和 Multisim 等其他仿真软件差不多。</p>
<a class="article-more-link" href="/2023/05/25/PSIM%E5%8F%8D%E6%BF%80%E5%8F%98%E6%8D%A2%E5%99%A8%E7%9A%84EMI%E5%88%86%E6%9E%90%E5%8F%8A%E4%BC%98%E5%8C%96/"
>阅读更多...</a
>

<!-- reward -->

</div>


<!-- copyright -->

<footer class="article-footer">

<ul class="article-tag-list" itemprop="keywords"><li class="article-tag-list-item"><a class="article-tag-list-link" href="/tags/C%E8%AF%AD%E8%A8%80/" rel="tag">C语言</a></li><li class="article-tag-list-item"><a class="article-tag-list-link" href="/tags/PSIM/" rel="tag">PSIM</a></li><li class="article-tag-list-item"><a class="article-tag-list-link" href="/tags/%E7%94%B5%E5%8A%9B%E7%94%B5%E5%AD%90/" rel="tag">电力电子</a></li><li class="article-tag-list-item"><a class="article-tag-list-link" href="/tags/%E7%94%B5%E7%A3%81%E5%85%BC%E5%AE%B9/" rel="tag">电磁兼容</a></li></ul>

</footer>
</div>




</article>


Expand Down
Loading

0 comments on commit 6eed6f7

Please sign in to comment.