Inference-Foundry.github.io/index.html at main · Inference-Foundry/Inference-Foundry.github.io · GitHub

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
<!DOCTYPE html>
<html lang="en">
<head>
  <meta charset="UTF-8" />
  <meta name="viewport" content="width=device-width, initial-scale=1" />
  <meta name="description" content="Inference Foundry is an open-source organization building tools and research for efficient local inference, large language models, and generative models." />
  <meta name="theme-color" content="#1e3a5f" />
  <title>Inference Foundry</title>
  <link rel="icon" type="image/jpeg" href="assets/images/inference-foundry-logo.jpg" />
  <link rel="preconnect" href="https://fonts.googleapis.com" />
  <link rel="preconnect" href="https://fonts.gstatic.com" crossorigin />
  <link href="https://fonts.googleapis.com/css2?family=Plus+Jakarta+Sans:ital,wght@0,400;0,500;0,600;0,700;1,400&display=swap" rel="stylesheet" />
  <link rel="stylesheet" href="css/main.css" />
  <meta property="og:title" content="Inference Foundry" />
  <meta property="og:description" content="Open-source tools and research for efficient inference and modern ML systems." />
  <meta property="og:type" content="website" />
  <meta property="og:image" content="https://inference-foundry.github.io/assets/images/inference-foundry-logo.jpg" />
  <meta name="twitter:card" content="summary_large_image" />
</head>
<body>
  <a class="skip-link" href="#main">Skip to content</a>
  <header class="site-header">
    <div class="site-header__inner">
      <a class="brand" href="https://inference-foundry.github.io/" aria-current="page">
        <img class="brand__logo" src="assets/images/inference-foundry-logo.jpg" width="44" height="44" alt="" decoding="async" />
        <span class="brand__text">
          <span class="brand__name">Inference Foundry</span>
          <span class="brand__tag">Open-source · Efficient inference</span>
        </span>
      </a>
      <nav class="nav" aria-label="Primary">
        <a href="#focus">Focus</a>
        <a href="#projects">Projects</a>
        <a href="#founders">Founders</a>
        <a href="#contact">Contact</a>
        <a href="#principles">Principles</a>
        <a href="https://github.com/Inference-Foundry" class="btn btn--ghost" target="_blank" rel="noopener noreferrer">GitHub</a>
        <a href="https://discord.gg/R8cgA4RpDV" class="btn btn--primary" target="_blank" rel="noopener noreferrer">Discord</a>
      </nav>
    </div>
  </header>

  <main id="main">
    <section class="hero" aria-labelledby="hero-heading">
      <div class="hero__inner">
        <div class="hero__visual">
          <div class="hero__logo-card">
            <img src="assets/images/inference-foundry-logo.jpg" alt="Inference Foundry logo — gear and neural motif" width="340" height="200" decoding="async" />
          </div>
        </div>
        <div class="hero__content">
          <h1 id="hero-heading">Research-grade tooling for local inference</h1>
          <p class="hero__lead">
            We build open-source software alongside research in language models, diffusion, and systems ML—with an emphasis on measurable performance, honest benchmarks, and sustainable engineering.
          </p>
          <div class="hero__actions">
            <a class="btn btn--primary" href="https://github.com/Inference-Foundry" target="_blank" rel="noopener noreferrer">View organization on GitHub</a>
            <a class="btn btn--ghost" href="#projects">Explore projects</a>
          </div>
        </div>
      </div>
    </section>

    <section class="section section--alt" id="focus" aria-labelledby="focus-heading">
      <div class="section__inner">
        <p class="section__eyebrow">What we work on</p>
        <h2 class="section__title" id="focus-heading">Focus areas</h2>
        <p class="section__intro">
          The Foundry brings together systems-minded contributors who care about what happens on real hardware—not only on slides.
        </p>
        <div class="focus-grid">
          <article class="focus-card">
            <h3>Efficient inference</h3>
            <p>Low-overhead runtimes, careful memory lifecycle, and reproducible latency and throughput measurements.</p>
          </article>
          <article class="focus-card">
            <h3>Language &amp; generative models</h3>
            <p>Tools and experiments grounded in current LLM and diffusion research, shared as open code and docs.</p>
          </article>
          <article class="focus-card">
            <h3>Open collaboration</h3>
            <p>Contributions welcome where evidence and scope are clear—see each repository for contribution guidelines.</p>
          </article>
        </div>
      </div>
    </section>

    <section class="section" id="projects" aria-labelledby="projects-heading">
      <div class="section__inner">
        <p class="section__eyebrow">Repositories</p>
        <h2 class="section__title" id="projects-heading">Projects</h2>
        <p class="section__intro">
          Active and upcoming initiatives under the Inference Foundry GitHub organization.
        </p>
        <div class="project-grid">
          <article class="project-card">
            <h3>super-ollama</h3>
            <p class="meta">Terminal-native local LLM engine</p>
            <p>
              Terminal-native, in-process local LLM engine (no HTTP in the main UX); <code>llama.cpp</code> via CGo, focus on low overhead and clean teardown.
            </p>
            <div class="project-card__links">
              <a href="https://github.com/Inference-Foundry/super-ollama" target="_blank" rel="noopener noreferrer">Repo</a>
              <a href="https://github.com/Inference-Foundry/super-ollama/wiki/Roadmap" target="_blank" rel="noopener noreferrer">Roadmap (wiki)</a>
            </div>
          </article>
          <article class="project-card">
            <h3>Crucible</h3>
            <p class="meta">Research journal &amp; lab notes</p>
            <p>
              Open research journal and experimental log.
            </p>
            <div class="project-card__links">
              <a href="https://github.com/Inference-Foundry/Crucible" target="_blank" rel="noopener noreferrer">Repo</a>
            </div>
          </article>
          <article class="project-card">
            <h3>BitForge</h3>
            <p class="meta">Planned</p>
            <p>
              Quantization theory, methods, and reproducible experiments across bit-widths and runtimes.
            </p>
            <div class="project-card__links">
              <a href="https://github.com/Inference-Foundry/.github/blob/main/docs/projects/quantization.md" target="_blank" rel="noopener noreferrer">Repo TBD — org doc</a>
            </div>
          </article>
          <article class="project-card">
            <h3>Lexicon</h3>
            <p class="meta">Planned</p>
            <p>
              Open fine-tuned prompt catalog with versioning, licensing, and analysis for reuse.
            </p>
            <div class="project-card__links">
              <a href="https://github.com/Inference-Foundry/.github/blob/main/docs/projects/prompt-library.md" target="_blank" rel="noopener noreferrer">Repo TBD — org doc</a>
            </div>
          </article>
          <article class="project-card">
            <h3>Argus</h3>
            <p class="meta">Planned</p>
            <p>
              Algorithms to detect AI-generated images using JEPA-based representations.
            </p>
            <div class="project-card__links">
              <a href="https://github.com/Inference-Foundry/.github/blob/main/docs/projects/argus.md" target="_blank" rel="noopener noreferrer">Repo TBD — org doc</a>
            </div>
          </article>
        </div>
      </div>
    </section>

    <section class="section section--alt" id="founders" aria-labelledby="founders-heading">
      <div class="section__inner">
        <p class="section__eyebrow">Leadership</p>
        <h2 class="section__title" id="founders-heading">Founders</h2>
        <p class="section__intro">
          Reach out directly to the founders or use the community Discord for contributor and project discussions.
        </p>
        <div class="founder-grid">
          <article class="founder-card">
            <div class="founder-card__media" aria-hidden="true">
              <img
                class="founder-card__photo"
                src="assets/images/team/kritarth-dandapat.jpg"
                alt="Portrait of Kritarth Dandapat"
                loading="lazy"
                decoding="async"
                onerror="this.style.display='none'; this.nextElementSibling.style.display='grid';"
              />
              <div class="founder-card__placeholder">KD</div>
            </div>
            <h3>Kritarth Dandapat</h3>
            <p class="meta">Founder · Project lead (Argus, Crucible)</p>
            <ul class="founder-card__links">
              <li><a href="https://github.com/Kritarth-Dandapat" target="_blank" rel="noopener noreferrer">GitHub</a></li>
              <li><a href="https://www.linkedin.com/in/kritarth-dandapat/" target="_blank" rel="noopener noreferrer">LinkedIn</a></li>
              <li>Discord: <code>kritarth2006</code></li>
            </ul>
          </article>

          <article class="founder-card">
            <div class="founder-card__media" aria-hidden="true">
              <img
                class="founder-card__photo"
                src="assets/images/team/atshal-ahmed-khan.jpg"
                alt="Portrait of Atshal Ahmed Khan"
                loading="lazy"
                decoding="async"
                onerror="this.style.display='none'; this.nextElementSibling.style.display='grid';"
              />
              <div class="founder-card__placeholder">AA</div>
            </div>
            <h3>Atshal Ahmed Khan</h3>
            <p class="meta">Founder · Team lead (super-ollama)</p>
            <ul class="founder-card__links">
              <li><a href="https://github.com/atshalahmedkhan" target="_blank" rel="noopener noreferrer">GitHub</a></li>
              <li><a href="https://www.linkedin.com/in/atshal-ahmed-631507251/" target="_blank" rel="noopener noreferrer">LinkedIn</a></li>
              <li>Discord: <code>atshal123</code></li>
            </ul>
          </article>
        </div>
      </div>
    </section>

    <section class="section section--alt" id="principles" aria-labelledby="principles-heading">
      <div class="section__inner">
        <p class="section__eyebrow">How we work</p>
        <h2 class="section__title" id="principles-heading">Principles</h2>
        <p class="section__intro">
          These expectations apply across our public spaces and reviews.
        </p>
        <ul class="principles">
          <li><strong>Evidence over opinion.</strong> Performance claims belong with methodology: hardware, versions, and raw artifacts when possible.</li>
          <li><strong>Safety and respect.</strong> Follow the organization <a href="https://github.com/Inference-Foundry/.github/blob/main/CODE_OF_CONDUCT.md">Code of Conduct</a>; debate the technical content, not the person.</li>
          <li><strong>Scope discipline.</strong> Large features start with discussion in the relevant repo so maintainers and contributors share context early.</li>
        </ul>
      </div>
    </section>

    <section class="cta" id="contact" aria-labelledby="cta-heading">
      <h2 id="cta-heading">Contact and collaborate</h2>
      <p>For contributors and collaborators, use Discord first. For direct contact, message the founders through GitHub or LinkedIn.</p>
      <a class="btn btn--primary" href="https://discord.gg/R8cgA4RpDV" target="_blank" rel="noopener noreferrer">Join Discord</a>
    </section>
  </main>

  <footer class="site-footer">
    <div class="site-footer__inner">
      <div class="footer-brand">
        <img src="assets/images/inference-foundry-logo.jpg" width="40" height="40" alt="" decoding="async" />
        <span>Inference Foundry</span>
      </div>
      <ul class="footer-links">
        <li><a href="https://github.com/Inference-Foundry" target="_blank" rel="noopener noreferrer">GitHub org</a></li>
        <li><a href="https://github.com/Inference-Foundry/.github" target="_blank" rel="noopener noreferrer">Org handbook (.github)</a></li>
        <li><a href="https://discord.gg/R8cgA4RpDV" target="_blank" rel="noopener noreferrer">Discord</a></li>
        <li><a href="https://github.com/Inference-Foundry/.github/blob/main/SECURITY.md" target="_blank" rel="noopener noreferrer">Security</a></li>
      </ul>
      <p class="site-footer__copy">&copy; Inference Foundry contributors</p>
    </div>
  </footer>
</body>
</html>