EU-compatible model options for Pilot
EU-compatible model options for PilotWhen Pilot drafts a reply or summarises a conversation, it sends the content of that conversation to a model endpoint. For most customer support contexts, those messages contain personal data — names, email addresses, account details, descriptions of problems. Where that data goes depends entirely on which model provider you have configured.This article covers your options if you need to keep that data under European control.Why model choice matters for data sovereigntyEvery inference request Pilot makes is a data transfer. If you are using OpenAI or Anthropic's hosted APIs, customer data is being processed on US infrastructure, by a US company, under US legal jurisdiction. That is not automatically a problem — both companies offer DPA agreements and maintain privacy programs — but it does mean you are relying on contractual protections and trans-Atlantic data transfer mechanisms that have a history of legal instability.For organisations that want stronger guarantees — public sector, healthcare, legal, financial services, or anyone with specific regulatory requirements — the practical answer is to use a model provider subject to EU law, or to run inference on your own infrastructure entirely.EU-compatible optionsMistral (French company, EU-hosted API)Mistral AI is a French company headquartered in Paris. Their API infrastructure is hosted in Europe, and they operate under French and EU legal frameworks. Mistral Large and Mistral Small both perform well on support drafting tasks.To use Mistral: get an API key at console.mistral.ai, enter it in Settings > Integrations > Pilot, and select your preferred Mistral model. If you need to confirm EU data residency, check Mistral's current DPA and infrastructure documentation — this is their explicit selling point and they publish it clearly.Gemma 4 (Google open weights, self-hostable)Gemma 4 is an open-weights model released by Google. "Open weights" means the model parameters are publicly available and you can run it on your own hardware. When you self-host, inference happens entirely on your infrastructure — no data leaves your environment.Gemma 4 runs well on modern consumer and server GPUs. For support drafting workloads, the smaller variants (Gemma 4 4B, 12B) are fast and resource-efficient.Qwen (Alibaba open weights, self-hostable)Qwen is an open-weights model family from Alibaba. Like Gemma, the weights are publicly available for self-hosted deployment. Qwen models are particularly strong on multilingual tasks, which is useful if your support team handles multiple languages.Whisper (OpenAI open weights, voice and transcription)If you are using Pilot for voice channel transcription, Whisper is the relevant model. OpenAI released Whisper as open weights, meaning it can be self-hosted. For EU deployments, running Whisper locally means voice data (which is often more sensitive than text) never leaves your infrastructure.Deployment pathsScalewayScaleway is a French cloud provider offering GPU compute in Paris and Amsterdam. Both Konversio's Docker Compose deployment and Ollama (for model serving) work on Scaleway. This gives you a complete stack — app, database, and model inference — on EU infrastructure under French law.NebiusNebius is a European AI cloud provider with GPU-optimised infrastructure. Konversio has been tested on Nebius as a deployment target. Nebius also offers managed model serving, so you can run Gemma, Qwen, or other open-weight models without managing the inference server yourself.Pointing Pilot at a self-hosted Ollama instanceOllama is the simplest way to run open-weight models locally or on your own server. Once Ollama is running and you have pulled a model (e.g. ollama pull gemma3:12b), configure Pilot as follows:Go to Settings > Integrations > PilotSelect Ollama as the providerEnter the base URL of your Ollama instance — for example http://localhost:11434 if it is on the same machine, or http://your-server-ip:11434 for a remote instanceEnter the model name exactly as it appears in your Ollama model listSave and test the connectionNo API key is required for Ollama. The test will confirm Konversio can reach your instance and get a valid response. If the test fails, check that Ollama is running, the port is accessible from your Konversio instance, and the model name is correct.