Set up development environment¶

Tooling¶

Installers¶

Standalone binaries¶

After downloading the archive corresponding to your platform and architecture, extract the binary to a directory that is on your PATH and rename to deva.

pip¶

deva is available on PyPI and can be installed with pip.

pip install deva

Windows¶

To build the agent on Windows, see datadog-agent-buildimages.

Linux and macOS¶

Python¶

The Agent embeds a full-fledged CPython interpreter so it requires the development files to be available in the dev env. The Agent can embed Python 2 and/or Python 3, you will need development files for all versions you want to support.

If you're on OSX/macOS, installing Python 2.7 and/or 3.12 with Homebrew:

brew install python@2
brew install python@3.12

On Linux, depending on the distribution, you might need to explicitly install the development files, for example on Ubuntu:

sudo apt-get install python2.7-dev
sudo apt-get install python3.12-dev

On Windows, install Python 2.7 and/or 3.12 via the official installer brings along all the development files needed:

Python Dependencies¶

To protect and isolate your system-wide python installation, a python virtual environment is highly recommended (though optional). It will help keep a self-contained development environment and ensure a clean system Python.

• Install the virtualenv module:

  python3 -m pip install virtualenv
  

• Create the virtual environment:

  virtualenv $GOPATH/src/github.com/DataDog/datadog-agent/venv
  

• Activate the virtualenv (OS-dependent). This must be done for every new terminal before you start.

If using virtual environments when running the built Agent, you may need to override the built Agent's search path for Python check packages using the PYTHONPATH variable (your target path must have the pre-requisite core integration packages installed though).

PYTHONPATH="./venv/lib/python3.12/site-packages:$PYTHONPATH" ./agent run ...

See also some notes in ./checks about running custom python checks.

Golang¶

You must install Golang version 1.23.5 or later. Make sure that $GOPATH/bin is in your $PATH, otherwise tooling cannot use any additional tool it might need.

Installing tools¶

From the root of datadog-agent, run inv install-tools to install go tooling. This uses go to install the necessary dependencies.

System or Embedded?¶

When working on the Agent codebase you can choose among two different ways to build the binary, informally named System and Embedded builds. For most contribution scenarios you should rely on the System build (the default) and use the Embedded one only for specific use cases. Let's explore the differences.

System build¶

System builds use your operating system's standard system libraries to satisfy the Agent's external dependencies. Since, for example, macOS 10.11 may provide a different version of Python than macOS 10.12, system builds on each of these platforms may produce different Agent binaries. If this doesn't matter to you—perhaps you just want to contribute a quick bugfix—do a System build; it's easier and faster than an Embedded build. System build is the default for all build and test tasks, so you don't need to configure anything there. But to make sure you have system copies of all the Agent's dependencies, skip the Embedded build section below and read on to see how to install them via your usual package manager (apt, yum, brew, etc).

Embedded build¶

Embedded builds download specifically-versioned dependencies and compile them locally from sources. We run Embedded builds to create Datadog's official Agent releases (i.e. RPMs, debs, etc), and while you can run the same builds while developing locally, the process is as slow as it sounds. Hence, you should only use them when you care about reproducible builds. For example:

• you want to build an agent binary that can be used as-is to replace the binary of an existing agent installation
• some dependencies are not available on your system
• you're working or debugging at a very low level: let's say you're adding a function to the Python bindings, you want to make sure you're using the exact same versions of Python as the official Agent packages

Embedded builds rely on Omnibus to download and build dependencies, so you need a recent ruby environment with bundler installed. See how to build Agent packages with Omnibus for more details.

Systemd¶

The agent is able to collect systemd journal logs using a wrapper on the systemd utility library.

On Ubuntu/Debian:

sudo apt-get install libsystemd-dev

On Redhat/CentOS:

sudo yum install systemd-devel

Docker¶

If you want to build a Docker image containing the Agent, or if you wan to run system and integration tests you need to run a recent version of Docker in your dev environment.

Doxygen¶

We use Doxygen to generate the documentation for the rtloader part of the Agent.

To generate it (using the inv rtloader.generate-doc command), you'll need to have Doxygen installed on your system and available in your $PATH. You can compile and install Doxygen from source with the instructions available here. Alternatively, you can use already-compiled Doxygen binaries from here.

To get the dependency graphs, you may also need to install the dot executable from graphviz and add it to your $PATH.

Pre-commit hooks¶

It is optional but recommended to install pre-commit to run a number of checks done by the CI locally.

Installation¶

To install it, run:

python3 -m pip install pre-commit
pre-commit install

The shellcheck pre-commit hook requires having the shellcheck binary installed and in your $PATH. To install it, run:

deva install-shellcheck --destination <path>

(by default, the shellcheck binary is installed in /usr/local/bin).

Skipping pre-commit¶

If you want to skip pre-commit for a specific commit you can add --no-verify to the git commit command.

Running pre-commit manually¶

If you want to run one of the checks manually, you can run pre-commit run <check name>.

You can run it on all files with the --all-files flag.

pre-commit run flake8 --all-files  # run flake8 on all files

See pre-commit run --help for further options.

Setting up Visual Studio Code Dev Container¶

Microsoft Visual Studio Code with the devcontainer plugin allow to use a container as remote development environment in vscode. It simplify and isolate the dependencies needed to develop in this repository.

To configure the vscode editor to use a container as remote development environment you need to:

• Install the devcontainer plugin and the golang language plugin.
• Run the following command inv vscode.setup-devcontainer --image "<image name>". This command will create the devcontainer configuration file ./devcontainer/devcontainer.json.
• Start or restart your vscode editor.
• A pop-up should show-up to propose to "reopen in container" your workspace.
• The first start, it might propose you to install the golang plugin dependencies/tooling.

Windows development environment¶

Code editor¶

Microsoft Visual Studio Code is recommended as it's lightweight and versatile.

Building on Windows requires multiple 3^rd-party software to be installed. To avoid the complexity, Datadog recommends to make the code change in VS Code, and then do the build in Docker image. For complete information, see Build the Agent packages