What is CoreWeave, and when would an AI team use it?
CoreWeave provides cloud infrastructure for training and serving AI models. Learn what its services do, what access requires, and how to plan a useful first evaluation.
Updated 5 min read
CoreWeave is a cloud platform for AI and high-performance computing: the infrastructure a team uses to train models, serve their answers, and run demanding calculations. Its getting-started guide (opens in a new tab) describes managed Kubernetes clusters and Slurm scheduling for distributed training. You would evaluate it when your question concerns running a workload on computing resources, rather than choosing a chat assistant. Tools like fenbs can keep your research and experiment notes so the next session begins with what you already tested.
What does CoreWeave provide?
A GPU is a processor suited to doing many calculations together, an important part of running many AI workloads. A cluster is a group of machines used together. Kubernetes organizes software across those machines; Slurm schedules computing jobs. You do not need to memorize those names, but you do need to know which operating approach your team can support.
| Your question | Relevant CoreWeave offering | What to establish |
|---|---|---|
| How will we operate a cluster? | CoreWeave Kubernetes Service, or CKS | Who prepares the workload and manages its Kubernetes configuration? |
| How will we schedule distributed training? | SUNK, which runs Slurm on Kubernetes | Does the team need a Slurm workflow, and who will provision users? |
| How will we serve model responses? | Inference services | Which serving approach meets the application requirements? |
CKS runs managed Kubernetes on bare-metal GPU and CPU infrastructure (opens in a new tab), meaning its Nodes are physical machines rather than a description of a personal AI account. The platform overview also identifies storage and observability, the tools for understanding how a running workload behaves. An evaluation should consider these supporting pieces together.
When would an AI team need this kind of cloud?
Say your team has a model and needs to establish whether it can handle a demanding batch of requests. You have a serving workload to evaluate. Another team may need several machines to train a model together. A third may have a scientific computing job. These are examples of infrastructure requirements; they do not establish which hardware or service any particular workload needs.
Write the need as an observable result: finish the agreed training run, serve the sample request set within your response target, or recover a stopped job without losing approved work. That statement gives the technical team a goal more useful than a request for a powerful GPU.
If your main job is selecting an assistant for research or writing, start with AI platforms for team work. If you are exploring where a model should run, the self-hosted AI models guide covers that separate decision. The choosing an AI model hub collects the wider selection questions.
What do you need before creating a cluster?
CoreWeave documents an activation invitation from Sales for an approved organization; the first invited user becomes an administrator. Treat account approval and permissions as prerequisites. A public hardware listing is not evidence that your account can immediately provision that hardware.
- Name the workload owner. Gather the model or application version, input location, expected output, and the person who will check the result.
- Confirm organization access. In the documented console navigation, Organization, Users handles invitations and Organization, Quotas handles quotas.
- Choose the operating route. Compute is the documented place to create a cluster; establish the required node pools and the people who need cluster access.
- Arrange credentials and tools. Tokens is the documented area for API tokens and kubeconfig, the configuration used to reach a Kubernetes cluster. SUNK also requires user provisioning and SSH keys.
- Agree on a stop condition before starting. Decide who can end the evaluation, what evidence must be saved, and who checks that the work has stopped.
Those steps follow the access boundaries and console labels in the getting-started documentation. Ask your administrator to resolve a missing permission rather than sharing a colleague’s credential. Keep credentials in an approved secret store; your evaluation notes need the access method and owner, not the secret itself.
How should you check hardware and capacity?
Use the instance availability matrix (opens in a new tab) to identify hardware listed for the relevant availability zone, a location in which cloud resources run. The matrix includes US locations, but actual availability remains subject to capacity. Check the specific hardware, location, quota, and intended start window together.
A second question is how you secure that capacity. CoreWeave’s capacity plans documentation (opens in a new tab) distinguishes Flex Reservations, Reserved Instances, Spot Instances, and On-Demand. Reserved and Flex plans guarantee contracted capacity; Spot and On-Demand do not. Spot can be interrupted. On-Demand is not preemptible but may be unavailable when demand peaks.
Choose a plan against the work’s tolerance for waiting or interruption. An experiment that can restart has different requirements from a committed delivery window. Record which assumptions still need commercial confirmation, including idle commitments and storage or transfer needs. A machine specification alone cannot settle those questions.
What should your first evaluation prove?
Use a small, representative workload before committing to a larger trial. Define the inputs, expected result, and repeatable acceptance check. Keep initialization time separate from the time spent doing useful work, and distinguish a successful launch from a completed, checked result.
- Correctness: did the workload produce the expected files or responses, and who checked them?
- Operation: can an authorized teammate start, inspect, and stop the same workload?
- Recovery: where is progress saved, and what happens if a worker is replaced?
- Evidence: which workload version, location, hardware choice, and configuration produced the result?
These are suggested evaluation criteria, not a benchmark we ran. Use AI model evaluation for the separate question of judging the model’s answers. Keep the infrastructure findings in fenbs so a later assistant can tell a tested result from an open question.
Which setup mistakes should you avoid?
CKS documentation says Nodes are stateless and boot from a clean operating-system image. Do not treat changes made on an individual Node as a lasting research record. Plan where reusable configuration, outputs, and checkpoints belong before relying on a successful interactive session.
CoreWeave also manages the NVIDIA GPU Operator and warns customers against installing another copy. Check the platform’s existing responsibilities before following a generic cluster tutorial. Platform identity permissions, cluster access, SUNK access, and object-storage authorization are separate boundaries; success at one boundary does not prove access at the others.
For a provider decision, use the separate CoreWeave and AWS infrastructure comparison. It applies a shared test plan to operating requirements rather than treating a hardware list as proof of a winner.
Never lose the work you did in an AI session
After a useful AI session, save it in fenbs: the key observations, findings, research and context. Then carry on from exactly where you left off, on any device and in any other AI. The next AI you connect reads it at the start of the session, so you never have to explain the same problem again.
Create a free accountFree for up to 5 people and 50 open tasks · No credit card · Works with Claude, ChatGPT, Cursor and more
How to keep your evaluation findings with fenbs
Keep the useful notes so you can carry on from exactly where you left off, on any device and with another AI. A short, accurate record is enough: what you tried, what happened, and the next thing to check.
- Create a free account.
- Add a task for your CoreWeave evaluation. Write what you want to find out and what a good result would look like.
- Save the public documentation links and your own experiment findings. Write “not tested” beside anything you have only read about. Leave out keys, private data, and raw sensitive logs.
- Write where you stopped and the next check. When you use another supported AI, connect it through Integrations and ask it to read those notes before helping.
fenbs keeps your research and experiment notes; it does not provide GPUs, run clusters, or replace infrastructure monitoring. If you only need to launch and inspect a workload, use the infrastructure tools responsible for that work. Use the saved notes when your next session needs to understand what you learned.