Skip to content

Commit

Permalink
sync changes:
Browse files Browse the repository at this point in the history
- M  site/categories/index.html

- A  site/categories/systems.html

- M  site/index.html
  • Loading branch information
elimelt committed Jan 15, 2025
1 parent 332cfe4 commit 3c7c941
Show file tree
Hide file tree
Showing 12 changed files with 1,477 additions and 14 deletions.
3 changes: 2 additions & 1 deletion site/categories/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -201,7 +201,8 @@ <h1>Categories</h1>
<li><a href="/categories/natural%20language%20processing.html">natural language processing</a> (2 pages)</li>
<li><a href="/categories/networking.html">networking</a> (1 pages)</li>
<li><a href="/categories/research.html">research</a> (3 pages)</li>
<li><a href="/categories/system-design.html">system-design</a> (1 pages)</li></ul>
<li><a href="/categories/system-design.html">system-design</a> (1 pages)</li>
<li><a href="/categories/systems.html">systems</a> (1 pages)</li></ul>
</div>

</main>
Expand Down
197 changes: 197 additions & 0 deletions site/categories/systems.html
Original file line number Diff line number Diff line change
@@ -0,0 +1,197 @@
<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="UTF-8">
<meta name="viewport" content="width=device-width, initial-scale=1.0">
<title>Category: systems</title>
<meta name="description" content="Pages in category systems">
<style>
:root {
--text-color: #1a1a1a;
--background-color: #ffffff;
--accent-color: #2563eb;
--border-color: #e5e7eb;
--nav-background: rgba(255, 255, 255, 0.95);
}

@media (prefers-color-scheme: dark) {
:root {
--text-color: #f3f4f6;
--background-color: #1a1a1a;
--accent-color: #60a5fa;
--border-color: #374151;
--nav-background: rgba(26, 26, 26, 0.95);
}
}

body {
font-family: -apple-system, BlinkMacSystemFont, "Segoe UI", Roboto, sans-serif;
line-height: 1.6;
max-width: 50rem;
margin: 0 auto;
padding: 2rem;
color: var(--text-color);
background: var(--background-color);
}

nav {
position: sticky;
top: 0;
background: var(--nav-background);
backdrop-filter: blur(10px);
border-bottom: 1px solid var(--border-color);
padding: 1rem 0;
margin-bottom: 2rem;
display: flex;
flex-wrap: wrap;
gap: 1rem;
z-index: 1000;
}

nav a {
color: var(--accent-color);
text-decoration: none;
padding: 0.5rem 1rem;
border-radius: 4px;
transition: background-color 0.2s;
}

nav a:hover {
background-color: var(--border-color);
}

.breadcrumbs {
margin-bottom: 2rem;
color: var(--text-color);
opacity: 0.8;
}

.breadcrumbs a {
color: var(--accent-color);
text-decoration: none;
}

.content {
margin-top: 2rem;
}

h1, h2, h3, h4, h5, h6 {
margin-top: 2rem;
margin-bottom: 1rem;
line-height: 1.3;
}

code {
background: var(--border-color);
padding: 0.2rem 0.4rem;
border-radius: 3px;
font-size: 0.9em;
font-family: 'SFMono-Regular', Consolas, 'Liberation Mono', Menlo, Courier, monospace;
}

pre {
background: var(--border-color);
padding: 1rem;
border-radius: 4px;
overflow-x: auto;
margin: 1.5rem 0;
}

pre code {
background: none;
padding: 0;
border-radius: 0;
}

img {
max-width: 100%;
height: auto;
border-radius: 4px;
margin: 1.5rem 0;
}

.meta {
color: var(--text-color);
opacity: 0.8;
font-size: 0.9em;
margin-bottom: 2rem;
display: flex;
flex-wrap: wrap;
gap: 1rem;
}

.tags {
margin-top: 2rem;
padding-top: 1rem;
border-top: 1px solid var(--border-color);
}

.tags a {
display: inline-block;
background: var(--border-color);
color: var(--text-color);
padding: 0.2rem 0.6rem;
border-radius: 3px;
text-decoration: none;
font-size: 0.9em;
margin-right: 0.5rem;
margin-bottom: 0.5rem;
}

.tags a:hover {
background: var(--accent-color);
color: white;
}

a {
color: #3391ff;
}

table {
width: 100%;
border-collapse: collapse;
margin: 1.5rem 0;
}

th, td {
padding: 0.75rem;
border: 1px solid var(--border-color);
}

th {
background: var(--border-color);
}

blockquote {
margin: 1.5rem 0;
padding-left: 1rem;
border-left: 4px solid var(--accent-color);
color: var(--text-color);
opacity: 0.8;
}
</style>
</head>
<body>
<nav>
<a href="/index.html">Home</a>
<a href="/categories/index.html">Categories</a>
<a href="/tags/index.html">Tags</a>
</nav>
<main>
<div class="breadcrumbs">
<a href="/index.html">Home</a> » Category: systems
</div>
<h1>Category: systems</h1>
<div class="meta">
<span>Last modified: 2025-01-14</span>

</div>
<div class="content">
<h2>Category: systems</h2>
<ul>
<li><a href="/systems-research/exokernel.html">Exokernel: An Operating System Architecture for Application-Level Resource Management</a></li></ul>
</div>

</main>
</body>
</html>
30 changes: 17 additions & 13 deletions site/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -189,22 +189,32 @@ <h1></h1>

<div class="landing-stats">
<div class="stat-item">
<span class="stat-value">154</span>
<span class="stat-value">156</span>
<span class="stat-label">Notes</span>
</div>
<div class="stat-item">
<span class="stat-value">15</span>
<span class="stat-value">16</span>
<span class="stat-label">Categories</span>
</div>
<div class="stat-item">
<span class="stat-value">100</span>
<span class="stat-value">103</span>
<span class="stat-label">Tags</span>
</div>
</div>
<div class="landing-grid">
<div class="recent-section">
<h2>Recent</h2>
<ul class='recent-posts'>
<li>
<a href="/systems-research/sparsity-notes.html">Sparsity Notes</a>
<span class="date">2025-01-14</span>

</li>
<li>
<a href="/systems-research/exokernel.html">Exokernel: An Operating System Architecture for Application-Level Resource Management</a>
<span class="date">2025-01-14</span>
<span class="category">systems</span>
</li>
<li>
<a href="/natural-language-processing/neural-networks.html">Feedforward Neural Networks</a>
<span class="date">2025-01-14</span>
Expand Down Expand Up @@ -244,16 +254,6 @@ <h2>Recent</h2>
<a href="/systems-research/paper-review-template.html">Paper Review Template</a>
<span class="date">2025-01-12</span>
<span class="category">research</span>
</li>
<li>
<a href="/systems-research/how-to-read-a-paper.html">How to Read a Paper</a>
<span class="date">2025-01-12</span>
<span class="category">research</span>
</li>
<li>
<a href="/natural-language-processing/reading/information-retrieval.html">Information Retrieval</a>
<span class="date">2025-01-07</span>

</li></ul>
</div>
<div class="categories-section">
Expand Down Expand Up @@ -318,6 +318,10 @@ <h2>Categories</h2>
<li>
<a href="/categories/system-design.html">system-design</a>
<span class="count">(1)</span>
</li>
<li>
<a href="/categories/systems.html">systems</a>
<span class="count">(1)</span>
</li></ul>
</div>
<div class="tags-section">
Expand Down
8 changes: 8 additions & 0 deletions site/natural-language-processing/neural-networks.html
Original file line number Diff line number Diff line change
Expand Up @@ -330,6 +330,14 @@ <h4 id="a-very-simple-example">A very simple example</h4>
\frac{\partial L}{\partial b} &amp;= \frac{\partial L}{\partial e} \cdot \frac{\partial e}{\partial d} \cdot \frac{\partial d}{\partial b} = 2c
\end{align</em>}
$$</p>
<h3 id="learning-details">Learning details</h3>
<p>NN optimization is a non-convex optimization problem, so it requires a few techniques to work well:</p>
<ul>
<li>Initialize weights and biases to small random values instead of all zeros</li>
<li>Normalize input values to $\mu = 0, \sigma = 1$</li>
<li>Dropout: randomly (with probability $p$) set some hidden units to 0, then renormalize other inputs to prevent overfitting</li>
<li>Hyperparameters: learning rate, mini-batch size, number of hidden units, number of layers, choice of activation function, etc.</li>
</ul>
</div>
<div class='tags'>Tags: <a href="/tags/deep%20learning.html">deep learning</a>, <a href="/tags/feedforward.html">feedforward</a>, <a href="/tags/machine%20learning.html">machine learning</a>, <a href="/tags/natural%20language%20processing.html">natural language processing</a>, <a href="/tags/neural%20networks.html">neural networks</a></div>
</main>
Expand Down
Loading

0 comments on commit 3c7c941

Please sign in to comment.