Earthmeta Earthmeta

DATA Open Source Explained by Dr. Eric Li

July 5th, 2018 at 7:07 am UTC · 3 min read

The DATA project is dedicated to solving data fraud, the lack of trust, the inefficiency of cooperation, the waste of ecological resources, and the uneven distribution of value in the global digital ecosystem through blockchain technology.

Through endpoint-level data credibility assessment, DATA hopes to address data traceability, validation incentives, and quality control issues.

DATA’s vision is to build a Data Trust Alliance with crucial partners in the digital ecosystem to develop and operate a standard protocol for quality assessment of endpoint data similar to the ISO certification system to reduce the inefficiency and high cost in the upstream and downstream of the industry chain due to the lack of trust in digital advertising, financial technology and other industries.

At present, the project has reached strategic collaborations with BlueFocus, Kochava and many other well-known companies in the world.

The Mobile Metadata Management System (M^3) is one of the most fundamental components of the DATA project. The system provides an off-chain metadata storage solution that is based on mobile devices for the blockchain ecosystem to solve the scalability issue.

This code released this time is mainly on the M^3 routing layer, which is based on the distributed Hash Table (DHT) used in peer-to-peer network research to increase the scalability of the network. Kademlia DHT is a commonly used protocol in the industry. The well-known industry projects IPFS (InterPlanetary File System) and Bittorrent also use Kademlia at the routing level. Kademlia’s original paper can be found at

Based on the original paper, Joshua implemented a Kademlia system and open sourced it: The project has 100 stars and 40 Forks, a relatively stable implementation in the industry. The M^3 project is based on Joshua’s open source code for secondary development and solves a large number of problems the source code encountered in actual applications.

For example, (1) we solved the problems the original project had in cross-network communication, (2) we modify the codes Android platform compatibility (3) We solved the persistent storage issues on different platforms (4) We also create our own REST api to perform unified remote node communication and invocation for different nodes in large-scale distributed networks.

Code reusing on a relatively stable open source system will ensure that the project has a relatively stable foundation and support from more industry partners. At the same time, after a lot of research, optimization, and testing, our current M^3 version 0.1.0 has successfully tested on networks consisted of VMs, PCs and mobile devices in 8 countries around the world, an accomplishment that the original code could not have completed.

Currently, our open code mainly includes the DHT routing layer, which is only a small portion of the M^3 system infrastructure. After more rigorous testing, we will gradually publicize the code of other system frameworks, such as Erasure Coding layer, File Storage layer, mobile network IP tracking layer, and so on. For the specific system infrastructure of M^3, please refer to the DATA white paper.

At the same time, we have received positive feedback and suggestions from the community regarding to this open source. The DATA team is very grateful to everyone for your supervision and concern. We will further strengthen communication with our community members, actively collect feedback and increase project development progress to an earlier realization of the DATA project’s vision.

Finally, we welcome developers who have participated in projects similar to Kademlia and are interested in mobile distributed storage to join our team and participate in the development of the M^3 project.