StructurIT: Generative AI for Cloud Architecture

At Devoteam Research, our mission is clear: explore cutting-edge technologies to create solutions that give our clients a competitive advantage.

We launched the Structurit project in this spirit of innovation. This ambitious initiative is at the heart of our Autonomous Cloud research axis.

Let me tell you more about what drives us!

The Challenge: Turning Ideas into Code

Cloud Computing has revolutionised how we design applications, but it has also introduced growing complexity. Today, transforming a business need expressed in natural language – for example, “We need an architecture that stores our customer data securely” – into concrete, optimised technical infrastructure is a manual, slow, and often costly process.

It’s a real headache for architects. They must juggle multiple services, security rules, and cost constraints.

Our Solution: Generative AI at the Helm

The StructurIT project aims to bridge this gap. Our ambition is to automate the design of technical architectures in the cloud using generative artificial intelligence.

We are developing a solution based on Large Language Models (LLMs) and AI agents capable of:

Understanding the user’s business need, even if it’s vague or informal
Reasoning about constraints (cost, performance, security, etc.)
Generating Infrastructure as Code (IaC) (such as Terraform) for infrastructure ready to be deployed

We’re not just seeking to generate text, but to build a true intelligent bridge between a company’s strategic vision and the technical reality of its infrastructure through AI Cloud Architecture.

A Laboratory of Ideas and Technologies

StructurIT is part of the Autonomous Cloud axis, one of the pillars of Devoteam Research. Our department is dedicated to exploring how AI can make the cloud more intelligent, efficient, and secure. It’s a unique research and experimentation environment. Every idea is tested and every discovery pushes the boundaries of what’s possible.

For Devoteam consultants, this is an opportunity to:

Develop cutting-edge expertise in generative AI technologies, agent orchestration, knowledge management, and dynamic APIs
Actively participate in creating an innovative and highly concrete GenAI use case
Apply their skills as an architect, developer, or data scientist to non-trivial problems and exciting AI Cloud architecture challenges

AQG4SD: A Concrete and Interactive Demo

To illustrate our work, we developed an interactive tool, AQG4SD (Automated GraphQL Query Generation for Service Discovery). This tool automates the discovery and selection of cloud services by translating natural language requirements into executable GraphQL queries.

The limitations that led to the development of our tool, AQG4SD, stem from a simple but major problem: the Cloud is constantly changing.

Previously, existing solutions for finding the right cloud service relied on static service catalogues. It’s like using an old paper catalogue to shop. As soon as a service is updated or a price changes, the catalogue becomes obsolete. These solutions used “ontologies” – very detailed service descriptions that required significant effort to create and were never up to date.

Our tool solves this problem by adopting a radically different approach. Instead of relying on a fixed catalogue, AQG4SD queries public APIs in real time. These APIs track prices and offerings from major cloud providers (such as AWS, Azure, GCP).

Imagine instead an assistant that, rather than searching through an outdated paper catalogue, uses an ultra-efficient, up-to-date search engine to instantly give you the best services and their current prices. By automating the generation of GraphQL queries to interrogate these APIs, our tool overcomes the main flaw of previous methods. It adapts to the dynamic nature of the cloud and ensures that the information used for selection is always relevant.

The Tool in Brief

AQG4SD’s architecture relies on a modular agent-based pipeline, designed to overcome the limitations of monolithic approaches. The key components are:

A central LLM. A Large Language Model (LLM), such as Gemini or GPT-4o, serves as the reasoning and generation engine. Its role is to understand user intent and formulate structured queries.

An advanced prompt engineering strategy. To guide the LLM, we dynamically inject the GraphQL schema of the target API and in-context learning examples. This approach reduces model inconsistencies and “hallucinations.”

Tools (MCP). The LLM agent is equipped with the ability to interact with external tools. This is where the MCP (Model Context Protocol) is crucial: it exposes a dedicated tool to the LLM for executing GraphQL queries, allowing the agent to “perform” a concrete action outside the model.

Orchestration logic. The orchestrator, implemented with LangGraph, manages the workflow. It breaks down the user’s query, interrogates the appropriate tools (via the MCP API), and aggregates results to provide a complete response.

The Multi-Query Orchestration Challenge

One of the major scientific challenges in AI Cloud Architecture lies in the inherent weakness of public pricing APIs, such as Infracost’s, which don’t natively support complex selection queries. A simple need like “find the cheapest service with at least 8GB of RAM” cannot be translated into a single API query.

Our solution overcomes this challenge by emulating operators like min, max, avg, order by, limit, etc., commonly found in database query languages like SQL, but missing for querying these GraphQL servers.

AQG4SD’s orchestrator is capable of:

Intelligently generating multiple GraphQL queries to obtain all necessary raw data. By “intelligently” we mean that the model is tasked with generating one or more parameterised GraphQL queries, along with value ranges for each parameter. This kills two birds with one stone: reducing the number of tokens to generate (and thus the solution’s cost) while simultaneously increasing the solution’s accuracy by relieving the LLM from generating all possible combinations (the Cartesian product) of parameters.

Delegating to an algorithmic module implemented within the MCP server the generation of all possible parameter combinations, the construction of final queries, and their execution.

Applying filters (for example, for services with a minimum RAM) and sorts (by price) in post-processing of obtained results.

Presenting a single, ordered, and filtered response to the user.

This multi-query and intelligent aggregation process is at the heart of our AI Cloud architecture, as it enables us to propose a reliable and optimised solution to our problem without having to modify the underlying API.

Demo

The AQG4SD tool will be demonstrated at the CoopIS 2025 conference to present our results to the scientific community. You can also test the tool yourself and see the magic happen live by installing the application from its source code hosted on the Devolab’s Gitlab.

AI Cloud Architecture: What‘s next?

We hope this presentation has given you a glimpse of the excitement at Devoteam Research. Don’t hesitate to contact us if you’re interested in discussing further!