Skip to content

Welcome to the Development Data Partnership!

A partnership between international organizations and companies, created to facilitate the use of third-party data in research and international development.

As part of the Development Data Partnership, members have access to:

  • Tools and snippets to get your data analysis up and running.
  • A Python package that includes both partner-specific and general facilitators.
  • A command-line toolbox that includes both partner-specific and general facilitators.

Frequently Asked Questions

  • Looking for learning more about the Data Partership and how it works? Go to our page.

  • Looking for available opportunities?

    Go to the Data Partnership Portal.

  • Looking for where to submit your project proposal?

    Go to the Data Partnership Portal.

  • Already had your proposal approved on the Portal?

    Go to the Data Partnership Board to check the status of your dataset.

Get Started

Probably you are looking where to start, so if:

You're done! Go ahead explore the documentation or install and contribute!

Resources

Awesome Data Partnership

A curated list of the Development Data Partnership public data goods and derivative works.

Documentation

Data documentation repositories curated for each Development Partner, based on their signed license agreements.

Links to All Data Documentation:

Important: The documentation may NOT be shared with persons outside of your organization.

Development Partner Documentation Package Repository
IDB Docs v0.2 GitHub
IMF Docs v0.2 GitHub
WBG Docs v0.2 GitHub

Links to each Data Partner's Documentation:

Important: The documentation may NOT be shared with persons outside of your organization.

Data Partner Repository WBG IDB IMF
Carto Examples
ClimaCell Examples
Cuebiq Examples
ESA Examples
ESRI Examples
Facebook Examples
Google Examples
Grab Examples
GSMA Examples
Indigo Examples
InLoco Examples
LinkedIn Examples
Mapbox Examples
Mapillary Examples
Mobike Examples
Orbital Insight Examples
Premise Examples
SafeGraph Examples
Twitter Examples
Uber Examples
Unacast Examples
Veraset Examples
Waze Examples
WhereIsMyTransport Examples
X-Mode Examples

Installation

The Partnership maintains a Python package that offers partner-specific and general helper functions.

Before installing the package, you will have to:

  1. Install Python 3.6+
  2. Set up GitHub with ssh. Alternatively, see username/password.

Unfortunately, the package not public, so you will have to be authenticated via GitHub.

Now you are ready to pip install! It is strongly recommended that you create a virtual environment.

Development Data Partner

Now choose the organization you belong to. You will have visilibity to all data partners and documentation your organization have agreements with.

IDB

If you are from the Inter-American Development Bank, install:

pip install git+ssh://git@github.com/datapartnership/devdatapartnership-idb.git@v0.2

IMF

If you are from the International Monetary Fund, install:

pip install git+ssh://git@github.com/datapartnership/devdatapartnership-imf.git@v0.2

WBG

If you are from the World Bank Group, install:

pip install git+ssh://git@github.com/datapartnership/devdatapartnership.git@v0.2

Verifying

Now you should have datapartnership installed on your environment.

>> import datapartnership
>> datapartnership.__version__
0.2.0

See examples on the documentation.

Can I use https instead?

We recommend ssh. Alternatively, you can change your global settings to use https instead.

That way, you will be able to login with your username and password. If you are using two-factor authentication on GitHUb, you will have to create a personal token.

Now change your global settings,

git config --global url."https://github.com/".insteadOf "git@github.com:"
git config --global credential.helper cache

Finally, while installing, use git+https://github.com/ instead of git+ssh://git@github.com/. For example,

pip install git+https://github.com/datapartnership/devdatapartnership.git

Contributing

Our documentation follows the literate programming paradigm.

Literate programming is a programming paradigm introduced by Donald Knuth in which a computer program is given an explanation of its logic in a natural language, such as English, interspersed with snippets of macros and traditional source code, from which compilable source code can be generated. Wikipedia

It requires nbdev. Check CONTRIBUTING.

Cloning

IDB

git clone --recurse-submodules git@github.com:datapartnership/devdatapartnership-idb.git

IMF

git clone --recurse-submodules git@github.com:datapartnership/devdatapartnership-imf.git

WBG

git clone --recurse-submodules git@github.com:datapartnership/devdatapartnership.git

Pulling

git pull --recurse-submodules

Pushing

As a member of the Development Data Partnership, you will be able to share and contribute to a common code base.

For that we use git submodules. Basically, each data partner has a home of its own

.
└── notebooks
    ├── core
    └── facebook

You can contribute as you would normally do by going to any subfolder/submodule,

# contribute to facebook
cd notebooks/facebook

# create your feature branch
git checkout -b <my-awesome-branch>

Make your contributions, adding and commiting and whenever you are ready,

# push your contributions
git push

As a final step, open a pull request on corresponding data partner repository (e.g., Facebook).