Skip to content

activate tenki in sandbox benchmarks#163

Merged
kisernl merged 3 commits into
masterfrom
add-tenki
Jul 21, 2026
Merged

activate tenki in sandbox benchmarks#163
kisernl merged 3 commits into
masterfrom
add-tenki

Conversation

@kisernl

@kisernl kisernl commented Jul 2, 2026

Copy link
Copy Markdown
Collaborator

This pull request re-enables support for the tenki provider in both the GitHub Actions workflow and the application code. The changes ensure that tenki is included in the list of providers run in the sandbox benchmarks and is available as a compute provider in the codebase.

Workflow configuration updates:

  • Enabled the tenki provider in the sandbox-benchmarks.yml workflow, so its benchmarks will now be executed.
  • Un-commented and enabled the TENKI_API_KEY secret in the workflow environment variables, allowing the workflow to authenticate with the tenki service.

Application code updates:

  • Re-enabled the import of the tenki provider in src/sandbox/providers.ts, making it available in the codebase.
  • Added the tenki provider back to the providers array, allowing it to be used as a compute provider with the required environment variable.

@open-cla

open-cla Bot commented Jul 2, 2026

Copy link
Copy Markdown

Contributor License Agreement

All contributors are covered by a CLA.

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Sandbox Benchmark Results

Sequential

# Provider Score Median TTI P95 P99 Status
1 isorun 99.7 0.02s 0.06s 0.06s 10/10
2 archil 98.3 0.14s 0.21s 0.21s 10/10
3 declaw 98.3 0.05s 0.35s 0.35s 10/10
4 createos 98.2 0.07s 0.34s 0.34s 10/10
5 lightning 97.5 0.22s 0.29s 0.29s 10/10
6 blaxel 96.8 0.23s 0.46s 0.46s 10/10
7 northflank 94.3 0.14s 1.22s 1.22s 10/10
8 modal 93.9 0.50s 0.78s 0.78s 10/10
9 runloop 93.6 0.59s 0.71s 0.71s 10/10
10 vercel 93.5 0.41s 1.01s 1.01s 10/10
11 cloud-run 93.5 0.61s 0.72s 0.72s 10/10
12 superserve 93.1 0.61s 0.81s 0.81s 10/10
13 tensorlake 88.9 0.91s 1.40s 1.40s 10/10
14 beam 88.2 0.40s 2.36s 2.36s 10/10
15 e2b 88.2 0.87s 1.66s 1.66s 10/10
16 tenki 84.6 1.28s 1.93s 1.93s 10/10
17 cloudflare 79.0 1.60s 2.85s 2.85s 10/10
18 upstash 78.4 2.13s 2.21s 2.21s 10/10
19 daytona 77.6 0.99s 4.12s 4.12s 10/10
20 codesandbox 75.0 2.34s 2.73s 2.73s 10/10
21 hopx 0.0 0.00s 0.00s 0.00s 0/10

Staggered

# Provider Score Median TTI P95 P99 Status
1 isorun 99.8 0.02s 0.03s 0.03s 10/10
2 declaw 99.5 0.04s 0.05s 0.05s 10/10
3 createos 98.4 0.07s 0.29s 0.29s 10/10
4 northflank 98.3 0.16s 0.18s 0.18s 10/10
5 lightning 97.9 0.19s 0.23s 0.23s 10/10
6 archil 97.8 0.13s 0.36s 0.36s 10/10
7 blaxel 97.7 0.23s 0.24s 0.24s 10/10
8 beam 94.7 0.37s 0.76s 0.76s 10/10
9 modal 94.4 0.53s 0.60s 0.60s 10/10
10 superserve 94.1 0.41s 0.87s 0.87s 10/10
11 runloop 93.2 0.57s 0.83s 0.83s 10/10
12 vercel 93.0 0.43s 1.10s 1.10s 10/10
13 e2b 89.7 0.95s 1.14s 1.14s 10/10
14 tensorlake 89.7 1.01s 1.07s 1.07s 10/10
15 cloud-run 87.9 0.60s 2.13s 2.13s 10/10
16 daytona 86.6 0.93s 1.97s 1.97s 10/10
17 tenki 81.8 1.37s 2.49s 2.49s 10/10
18 upstash 77.7 2.13s 2.37s 2.37s 10/10
19 cloudflare 77.1 1.96s 2.78s 2.78s 10/10
20 codesandbox 75.1 2.34s 2.71s 2.71s 10/10
21 hopx 0.0 0.00s 0.00s 0.00s 0/10

Burst

# Provider Score Median TTI P95 P99 Status
1 isorun 99.8 0.02s 0.02s 0.02s 10/10
2 declaw 99.4 0.06s 0.07s 0.07s 10/10
3 createos 98.9 0.10s 0.12s 0.12s 10/10
4 northflank 98.1 0.17s 0.23s 0.23s 10/10
5 archil 97.7 0.15s 0.36s 0.36s 10/10
6 blaxel 96.9 0.29s 0.33s 0.33s 10/10
7 lightning 96.8 0.21s 0.48s 0.48s 10/10
8 beam 95.5 0.36s 0.59s 0.59s 10/10
9 superserve 94.5 0.54s 0.56s 0.56s 10/10
10 modal 94.1 0.57s 0.62s 0.62s 10/10
11 vercel 93.9 0.43s 0.87s 0.87s 10/10
12 e2b 90.5 0.90s 1.03s 1.03s 10/10
13 cloud-run 90.3 0.68s 1.41s 1.41s 10/10
14 tensorlake 90.1 0.98s 1.01s 1.01s 10/10
15 daytona 84.6 1.07s 2.24s 2.24s 10/10
16 tenki 81.4 1.50s 2.41s 2.41s 10/10
17 runloop 80.7 0.61s 3.91s 3.91s 10/10
18 upstash 74.5 2.15s 3.14s 3.14s 10/10
19 codesandbox 69.7 2.70s 3.51s 3.51s 10/10
20 cloudflare 58.3 3.36s 5.39s 5.39s 10/10
21 hopx 0.0 0.00s 0.00s 0.00s 0/10

View full run · SVGs available as build artifacts

# Conflicts:
#	.github/workflows/sandbox-tti-benchmarks.yml
@github-actions

github-actions Bot commented Jul 21, 2026

Copy link
Copy Markdown
Contributor

Sandbox Dax Benchmark Results

Provider Phases Total Prepare Clone Install Typecheck Status
archil 0/7 0.00s 0.00s 0.00s 0.00s 0.00s 0/1 OK
beam 6/7 36.39s 18.86s 1.82s 6.38s 0.00s 0/1 OK
blaxel 0/7 0.00s 0.00s 0.00s 0.00s 0.00s 0/1 OK
cloud-run 2/7 1.67s 0.48s 0.00s 0.00s 0.00s 0/1 OK
cloudflare 0/7 0.00s 0.00s 0.00s 0.00s 0.00s 0/1 OK
codesandbox 0/7 0.00s 0.00s 0.00s 0.00s 0.00s 0/1 OK
createos 6/7 7.34s 2.85s 2.05s 1.46s 0.00s 0/1 OK
daytona -- 0.00s 0.00s 0.00s 0.00s 0.00s 0/1 OK
declaw 7/7 98.11s 8.60s 6.98s 24.44s 39.96s 1/1 OK
e2b 7/7 70.41s 8.34s 3.29s 9.03s 41.03s 1/1 OK
hopx -- 0.00s 0.00s 0.00s 0.00s 0.00s 0/1 OK
isorun -- 0.00s 0.00s 0.00s 0.00s 0.00s 0/1 OK
lightning 0/7 0.00s 0.00s 0.00s 0.00s 0.00s 0/1 OK
modal 7/7 99.48s 4.32s 2.44s 14.62s 69.37s 1/1 OK
namespace 7/7 64.12s 5.35s 3.88s 9.57s 28.87s 1/1 OK
northflank -- 0.00s 0.00s 0.00s 0.00s 0.00s 0/1 OK
runloop 2/7 132.67s 0.00s 0.00s 29.33s 61.67s 1/1 OK
superserve 6/7 32.14s 21.88s 3.78s 3.81s 0.00s 0/1 OK
tenki 6/7 23.41s 3.28s 3.89s 12.01s 0.00s 0/1 OK
tensorlake 7/7 70.63s 12.06s 1.52s 12.89s 38.12s 1/1 OK
upstash 0/7 0.00s 0.00s 0.00s 0.00s 0.00s 0/1 OK
vercel 7/7 85.49s 17.17s 1.92s 13.11s 45.43s 1/1 OK

View full run

@kisernl
kisernl merged commit 6bd5b80 into master Jul 21, 2026
48 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant