CATEGORY · 17 TOOLS
This category covers the building blocks behind AI products: model APIs such as Google AI Studio and Cohere, routers such as OpenRouter, open-weight model families from DeepSeek, Meta, Alibaba and Mistral, local runtimes such as Ollama and LM Studio, and supporting infrastructure for vector search, evaluation, notebooks and GPU compute.
WHERE THESE 17 TOOLS KEEP DATA
- AU hosting option3
- Can run onshore8
- Runs on your device2
- No AU option published4
001 / OUR PICKS
Two trends defined 2025 and 2026. Open-weight models narrowed the gap with closed models for many business tasks, making it practical to run capable models on your own hardware or cloud account. At the same time, the Model Context Protocol became a common way to connect models to tools and data, so frameworks and platforms now compete on how well they support agents rather than plain chat.
Australian users include software companies embedding AI in their products, data teams in banks, universities and government building internal assistants, and agencies delivering custom systems for clients. Many choose their stack around one requirement first: whether prompts and data must stay in an Australian region.
- #1
Hugging Face
DEVELOPER PLATFORMS & MODELS
An open platform for sharing and running AI models, datasets and demo apps, used to find, test and deploy open-source models. Teams can browse model cards, run models through hosted inference, and pull weights into their own infrastructure.
Best for machine learning engineers evaluating and fine-tuning open models
Onshore possibleFreemiumAdvanced - #2
Google AI Studio
DEVELOPER PLATFORMS & MODELS
Google's free browser-based workspace for trying Gemini models, testing prompts, generating API keys and building apps. Its Build mode generates complete web or Android apps from a prompt, which you can export to GitHub or deploy to Google Cloud Run.
Best for developers prototyping with Gemini before production
Onshore possibleFreemiumIntermediate - #3
OpenRouter
DEVELOPER PLATFORMS & MODELS
A unified API that gives developers access to hundreds of AI models from many providers through one key and an OpenAI-compatible interface. It handles routing, fallbacks when a provider fails, usage tracking and consolidated billing, and lets teams filter providers by data policy, price or speed.
Best for developers comparing models before committing to a provider
OffshoreFreemiumIntermediate - #4
Ollama
DEVELOPER PLATFORMS & MODELS
An open-source tool for downloading and running open-weight language models on a Mac, Windows or Linux machine, or on your own server. It provides a simple command line, a desktop app and a local API, plus optional paid cloud models for larger workloads.
Best for developers prototyping with open models on their own machines
On deviceFreemiumIntermediate - #5
LangChain
DEVELOPER PLATFORMS & MODELS
An open-source framework for building applications and agents on top of large language models, alongside LangGraph for stateful agent workflows and LangSmith, a paid platform for tracing, evaluating and deploying those applications.
Best for development teams building custom AI agents and document chatbots
AU optionFreemiumAdvanced - #6
Cohere
DEVELOPER PLATFORMS & MODELS
A Canadian enterprise AI company that builds the Command family of generative models, Embed models for semantic search and Rerank models for retrieval. Its North platform packages these into an agent workspace for staff. Cohere focuses on private deployment, letting organisations run models in their own cloud, on-premises or fully disconnected environments.
Best for government and regulated organisations needing models in their own environment
Onshore possibleFreemiumAdvanced
ALSO IN THIS CATEGORY · 11
DeepSeek
DEVELOPER PLATFORMS & MODELS
A family of large language models from Chinese AI lab DeepSeek, covering general chat and step-by-step reasoning. The model weights are published under the permissive MIT licence, so they can be downloaded and self-hosted, and DeepSeek also runs its own chat app and paid API.
Best for engineering teams able to self-host open models on their own GPUs
Onshore possibleFreemiumAdvancedFal.ai
DEVELOPER PLATFORMS & MODELS
A developer platform for running generative media models through an API. It hosts a large catalogue of image, video, audio and 3D models from several labs, and offers serverless GPUs for deploying your own models.
Best for developers adding image or video generation to their own products
OffshorePaidAdvancedGoogle Colab
DEVELOPER PLATFORMS & MODELS
Google's hosted Jupyter notebook service. You write and run Python in the browser with no setup, with access to GPUs and TPUs, and Gemini built in to write, explain and fix code. Notebooks save to Google Drive and can be shared like a Google Doc.
Best for students and analysts learning Python and data analysis
AU optionFreemiumIntermediateHugging Face Spaces
DEVELOPER PLATFORMS & MODELS
Hugging Face's hosting service for machine learning demos and small apps. Developers publish apps built with Gradio, Docker or static HTML, and anyone can try a large catalogue of public Spaces in the browser, from image generators to transcription and document tools.
Best for developers sharing proof-of-concept demos with stakeholders
OffshoreFreemiumIntermediateLightning.ai
DEVELOPER PLATFORMS & MODELS
An AI development cloud from the creators of PyTorch Lightning. Lightning Studios give developers browser-based coding environments on cloud GPUs for training, fine-tuning and serving models, and after merging with Voltage Park it also offers large-scale GPU capacity under the Lightning AI name.
Best for machine learning engineers fine-tuning open-source models
Onshore possibleFreemiumAdvancedLlama
Meta · DEVELOPER PLATFORMS & MODELS
Meta's family of open-weight large language models, released in sizes from small models that run on a laptop to large multimodal models for servers. Businesses download the weights to self-host, fine-tune for their own tasks, or use managed versions on major cloud platforms.
Best for organisations wanting a private chatbot on their own infrastructure
Onshore possibleFreeAdvancedLM Studio
DEVELOPER PLATFORMS & MODELS
A desktop app for Mac, Windows and Linux that lets you discover, download and chat with open-weight models offline. It includes document chat, a local server with OpenAI-compatible endpoints for developers, and support for MCP tools, all through a graphical interface.
Best for non-technical staff who want private AI on their laptop
On deviceFreeBeginnerMistral AI
DEVELOPER PLATFORMS & MODELS
Mistral AI's family of language models, from small efficient models to large multimodal ones. Many are released as open weights for self-hosting, mostly under the Apache licence, and Mistral also offers a paid API, the Le Chat assistant and enterprise tools for custom deployments.
Best for organisations wanting a European alternative to US model providers
Onshore possibleFreemiumAdvancedPinecone
DEVELOPER PLATFORMS & MODELS
A fully managed vector database and knowledge platform. It stores embeddings of your documents or products so AI applications can find relevant content by meaning, the retrieval step behind document chatbots and semantic search, and adds Pinecone Assistant for managed question answering over files.
Best for developers building retrieval-augmented chatbots over company documents
OffshoreFreemiumAdvancedQwen
Alibaba · DEVELOPER PLATFORMS & MODELS
Alibaba's Qwen family of language models. Many models, from small to very large, are released as open weights, covering chat, coding, vision and reasoning. Most use the Apache licence, though some larger releases carry Alibaba's own terms. Enhanced flagship versions are offered through Alibaba's paid Qwen Cloud API.
Best for businesses producing content in Chinese and other Asian languages
Onshore possibleFreemiumAdvancedWeights & Biases
DEVELOPER PLATFORMS & MODELS
A developer platform for machine learning teams, now owned by CoreWeave and sold as part of its CoreWeave Forge platform. It tracks model training experiments, versions datasets and models in a registry, and through its Weave product traces, evaluates and monitors applications built on large language models.
Best for data science teams training or fine-tuning their own models
AU optionFreemiumAdvanced
002 / HOW TO CHOOSE
- 01
Hosted API, cloud platform or self-hosted
Direct vendor APIs are quickest to start. Cloud platforms such as AWS Bedrock, Azure and Google Cloud add enterprise contracts and regional hosting. Self-hosting open models gives the most control but needs GPUs, monitoring and staff who can keep it running.
- 02
Licence terms for open models
Open-weight does not always mean open source. Read each model's licence for commercial use limits, attribution rules and acceptable use restrictions, and check whether fine-tuned versions inherit them. Record which licence applies to every model in production.
- 03
Region and provider due diligence
Check which regions a model is offered in, and who operates the endpoint. A model served by a third-party router or inference host may run in a different country from the original developer. Government and critical infrastructure work may also restrict certain vendors entirely.
- 04
Observability and evaluation
Production systems need tracing, cost tracking and automated tests that compare model outputs over time. Choose tooling that stores traces where you are comfortable holding customer messages, and that lets you swap models without rewriting your application.
- 05
Cost controls
Usage-based pricing can grow quickly with agents and long documents. Set spending limits per key, cache repeated prompts, route simple tasks to smaller models and monitor token use per feature so you can see which parts of your product are expensive.
AWS, Microsoft Azure and Google Cloud all operate Sydney and Melbourne regions, and several offer selected frontier and open models there, which is the usual route for keeping inference onshore under the Privacy Act 1988 and client contracts. Direct vendor APIs and routers generally process requests in the US. Australian Government entities must block DeepSeek products under PSPF Direction 001-2025, and suppliers to government should expect similar questions. Training or fine-tuning on customer data needs a clear collection notice and purpose. Local runtimes such as Ollama keep everything on your own machine. Cloud marketplaces can bill in Australian dollars through an existing account, while most AI-native vendors bill in US dollars.
004 / QUESTIONS
Anything else is quicker to answer on a call. Thirty minutes, free, with the people who would build it.
Use models offered in an Australian region through AWS Bedrock, Azure or Google Cloud, or run open-weight models on your own servers or GPU instances in Sydney or Melbourne. Check that logging, vector databases and evaluation tools are also onshore, because traces and embeddings often contain the same personal information as the prompts.
Thirty minutes, free. Tell us the job and we'll tell you which tool we'd use, and how we'd set it up.
Book a free call→