diff --git a/index.html b/index.html index 70cf1f0..d0f35de 100644 --- a/index.html +++ b/index.html @@ -63,7 +63,7 @@
tinygrad| - docs| + docs| jobs| tinybox (buy now!)| FAQ @@ -72,13 +72,13 @@

tinygrad

-

We write and maintain tinygrad, the fastest growing neural +

We write and maintain tinygrad, the fastest growing neural network framework

It's extremely simple, and breaks down the most complex networks into 3 OpTypes

+ href="https://github.com/tinygrad/tinygrad/blob/master/examples/llama.py" target="_blank">complex networks into 3 OpTypes

ElementwiseOps are UnaryOps, BinaryOps, and TernaryOps.
They operate on 1-3 tensors and run elementwise.
@@ -86,15 +86,15 @@

tinygrad

ReduceOps operate on one tensor and return a smaller tensor.
example: SUM, MAX

MovementOps are virtual ops that operate on one tensor and move the data around
- Copy-free with ShapeTracker.
+ Copy-free with ShapeTracker.
example: RESHAPE, PERMUTE, EXPAND, etc...

But how...where are your CONVs and MATMULs? Read the code to solve this mystery.

Work at tiny corp

- We are now funded and hiring full time software engineers. Very talented interns okay.

- See our bounty page to judge if you might be a good fit. Bounties pay you while judging that fit.

+ We are now funded and hiring full time software engineers. Very talented interns okay.

+ See our bounty page to judge if you might be a good fit. Bounties pay you while judging that fit.

We are also hiring for operations and hardware, but if you haven't contributed to tinygrad your application won't be considered.
@@ -103,7 +103,7 @@

tinybox (now shipping)

We sell a computer called the tinybox. It comes in two colors.

- + @@ -112,15 +112,15 @@

tinybox (now shipping)

- + - - + +
redgreen v2
FP16 (FP32 acc) FLOPS738 TFLOPS1492 TFLOPS
FP16 (FP32 acc) FLOPS738 TFLOPS1492 TFLOPS
GPU Model6x 7900XTX4x 5090
GPU RAM144 GB128 GB
GPU RAM bandwidth5760 GB/s7168 GB/s
System RAM128 GB192 GB
System RAM bandwidth204.8 GB/s460.8 GB/s
Disk size4 TB raid array + 1 TB boot
Disk read bandwidth28.7 GB/s28.7+ GB/s
Disk read bandwidth28.7 GB/s28.7+ GB/s
Networking2x 1 GbE + open OCP3.0 slot2x 10 GbE + 2x 1 GbE + open OCP3.0 PCIe5
Noise< 50 dB, 31 low speed fans
Power Supply2x 1600W, 100V~240V
BMCAST2500AST2600
Operating SystemUbuntu 22.04Ubuntu 24.04
Dimensions12U, 16.25" deep, 90 lbs
Rack?Freestanding or rack mount
Driver QualityDevelopingGreat
Rack?Freestanding or rack mount
Driver QualityDevelopingGreat
SHIPPINGIN STOCK - $15,000IN STOCK - $29,000

@@ -131,13 +131,13 @@

tinybox (now shipping)

FAQ

What is a tinybox?
-
It is a very powerful computer for deep learning, and likely the best performance/$. It was benchmarked in MLPerf Training 4.0 vs computers that cost 10x as much. And of course, anything that can train can do inference.
+
It is a very powerful computer for deep learning, and likely the best performance/$. It was benchmarked in MLPerf Training 4.0 vs computers that cost 10x as much. And of course, anything that can train can do inference.
How do I get a tinybox?
Place an order through the links above. The factory is up and running, and it will ship within one week of us receiving the payment. Currently offering pickup in San Diego + shipping worldwide.
Where can I learn more about the tinybox?
-
We have a lot of content on our Twitter, we also have a tinybox docs page and a #tinybox discord channel.
+
We have a lot of content on our Twitter, we also have a tinybox docs page and a #tinybox discord channel.
Can I customize my tinybox?
In order to keep prices low and quality high, we don't offer any customization to the box or ordering process. Of course, after you buy the tinybox, it's yours and you are welcome to do whatever you want with it!
@@ -149,13 +149,13 @@

FAQ

In order to keep prices low and quality high, we don't offer any customization to the box or ordering process. Wire transfer is the only accepted form of payment.
Is tinygrad used anywhere?
-
tinygrad is used in openpilot to run the driving model on the Snapdragon 845 GPU. It replaces SNPE, is faster, supports loading onnx files, supports training, and allows for attention (SNPE only allows fixed weights).
+
tinygrad is used in openpilot to run the driving model on the Snapdragon 845 GPU. It replaces SNPE, is faster, supports loading onnx files, supports training, and allows for attention (SNPE only allows fixed weights).
Is tinygrad inference only?
-
No! It supports full forward and backward passes with autodiff. This is implemented at a level of abstraction higher than the accelerator specific code, so a tinygrad port gets you this for free.
+
No! It supports full forward and backward passes with autodiff. This is implemented at a level of abstraction higher than the accelerator specific code, so a tinygrad port gets you this for free.
How can I use tinygrad for my next ML project?
-
Follow the installation instructions on the tinygrad repo. It has a similar API to PyTorch, yet simpler and more refined. Less stable though while tinygrad is in alpha, so be warned, though it's been fairly stable for a while.
+
Follow the installation instructions on the tinygrad repo. It has a similar API to PyTorch, yet simpler and more refined. Less stable though while tinygrad is in alpha, so be warned, though it's been fairly stable for a while.
When will tinygrad leave alpha?
When we can reproduce a common set of papers on 1 NVIDIA GPU 2x faster than PyTorch. We also want the speed to be good on the M1. ETA, Q2 next year.
@@ -168,14 +168,14 @@

FAQ

Where is tinygrad development happening?
-
On GitHub and on Discord
+
On GitHub and on Discord
How can the tiny corp work for me?
Email me, george@tinygrad.org. We are looking for contracts and sponsorships to improve various aspects of tinygrad.
How can I work for the tiny corp?
-
See hiring above. Contributions to tinygrad on GitHub +
See hiring above. Contributions to tinygrad on GitHub always welcome, and a good way to get hired.
@@ -186,4 +186,4 @@

FAQ

To accelerate. We will commoditize the petaflop and enable AI for everyone.
- + \ No newline at end of file