Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create Decentralized and Trustworthy AI enabled by Polkadot.md #1814

Closed
wants to merge 4 commits into from
Closed
Changes from 3 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
190 changes: 190 additions & 0 deletions Decentralized and Trustworthy AI enabled by Polkadot.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,190 @@
# Enabling Decentralized and Trustworthy AI Services on Polkadot

- **Team Name:** AI + Blockchain on Polkadot
- **Payment Address:** 0x9f50E023606420050b8BCe7d9100C7924e88dAB6
- **[Level](https://github.com/w3f/Grants-Program/tree/master#level_slider-levels):** 2


### Overview
With the rapid development of AI, there are also rising issues, concerns and risks of centralized AI made and controlled by few tech giants in private. Therefore we believe the future of AI should be decentralized on blockchain to be transparent, democratic and reliable with public contributions and consensus. Blockchain can help AI have healthy, accountable and sustainable development in the long term.

By combining Polkadot blockchain with AI, our project applies the decentralization of Polkadot blockchain to make AI services trustworthy. With Polkadot blockchain, we enable users to trace and protect the usage of their personal data in AI in a privacy-preserving way, and they can self-verify the whole process and results of their AI services to ensure their compliance and correctness.

We also enable AI services to open the modeling and training of their AI for everyone in public to freely and equally improve and contribute including data, algorithms and computation power. All contributors can get corresponding returns according to their contributions to the earnings of those AI services, so the development of AI could become much faster, better and safer.


### Project Details

**Project Design:**

Specifically our project is divided into two parts. One part is to make AI trustworthy by protecting the privacy of personal data used for AI, tracing the source and usage of data in AI. We also enable AI services to become more transparent by opening their running process so people can self-verify the correctness and compliance of their computation results.

Another part is to make AI more cooperative in public. Others can freely and equally contribute to AI and blockchain will record their contributions and distribute corresponding returns as incentives via tokens. Everyone can upload their privacy-preserving data for AI training, improve AI algorithms for modeling, and share their computing power for AI execution. As for the AI services involving public interests, everyone can also participant in their governance to reach consensus on their ethics, justice and inclusivity without bias or discrimination.

Both parts are interconnected for a better AI services with user network, online content and applications. With users, data and resources in the service, AI could be applied and used in online services and applications. After that it incurs more valuable data to make AI better for more usage and applications, forming a positive cycle.

**Project Components:**

We will use privacy-preserving techniques like zero knowledge proofs to protect the privacy of the data and model in AI while they are still traceable, verifiable, and trustworthy. We ensure the privacy of users will not be revealed when their personal data are used for AI modeling and training. Online services can also make their AI fully open-source or not reveal any parts in a privacy-preserving way. Even though they choose to not reveal their AI models, they can still self-prove their correctness, reliability, and compliance to everyone. Everyone can also adjust and improve them based on their running results to make them better.

To address the bottlenecks of performance on blockchain, we will use the scaling techniques like layer 2 to put the huge workload of AI off-chain and raise the performance of blockchain. We also further optimize the allocation and distribution of AI resources and workload among all nodes on blockchain from data processing, AI modeling and training, to computation and execution.

To give each participant and contributor corresponding returns according to the value they make, we will design an effective incentive mechanism to count and reward the contributions of everyone to the AI on blockchain including data sharing, improvement of algorithms, and computation power. The earnings of AI services will be tracked and distributed among all contributors according to the value of their contributions as incentives.

Specifically our project will having the follwing core functionalites and features:

**1. Decentralized AI modeling and training using privacy-preserving data:** Everyone can contribute their data to AI for modeling and training with corresponding returns as incentives. We will manage the authorization of users, protect the security and verify the integrity of their data in a fully privacy-preserving way.

**2. Public AI improvement, auditing, and consensus:** Everyone can upgrade and improve AI algorithms to optimize their performance, and they will be rewarded according to their their contributions. Everyone can also help correct any bias, discrimination, and mistakes within AI and reach consensus on essential settings and parameters involving public interests to make AI ethical, constitutional and justicial.

**3. Trustworthy verification of AI execution results:** As the intelligence of AI can approach even exceed human beings, people are hard to validate the outputs of AI by themselves. With techniques like ZKML, people can verify the computation results of AI quickly to ensure their correctness and authenticity as expected. With blockchain, everyone can self-verify those AI providing public services and involving public benefits to ensure they are fully reliable and trustworthy.


In the project we will also provide the following deliverables:

- MVP version with the source code of front-end, back-end and smart contract
- Technical specifications with implementation details and parameters
- Project documentation core components, protocols, and architecture
- Project research report with research paper and publications
- High-fidelity Prototype with user-friendly interfaces
- Data models / API / SDK of the core functionality

### Ecosystem Fit

Our project can help Polkadot win a place in the coming era of AI. We will apply Polkadot blockchain into AI and also use AI to benefit the ecosystem of Polkadot. Specifically:

Empowered by AI, users can get better blockchain services in Polkadot, and they can contribute to AI with their data under authorization, privacy protection and incentives to help improve AI with more qualified data as inputs to get better AI services. They can also self-verify the execution of AI algorithms to trust the results of AI services on Polkadot.

As for AI developers, everyone can help audit and improve AI algorithms like their modeling and training, and provide their computation resources to help run AI algorithms. Blockchain will track and record their contributions immutably. AI services will distribute their earnings with all contributors according to the value of their contributions to reward them corresponding returns fairly.

AI services can also open its development and improvement to all developers in public. In this way AI can be improved and developed better in higher efficiency, quality, equality and inclusivity. Everyone can freely and equally contribute to AI services with better algorithms and new computation resources. The earnings of AI services will be fairly distributed among all developers according to the value of their contributions.


## Team :busts_in_silhouette:

### Team members

- Name of team leader: Blockchain Researcher and Entrepreneur Jel Yin
- Names of team members: Blockhain Research Scientist Dr.Alex Liu and Vincent Liu, Blockchain Developer Myron Zhang

### Contact

- **Contact Name:** Jel Yin
- **Contact Email:** [email protected]
- **Personal Resume:** https://drive.google.com/file/d/1Vf_HWsW9nTqC_0cM23SrJTD6-AHqvrDG/view?usp=sharing

### Team's experience
We are a highly collaborative, creative and productive team made up of talented entrepreneurs, innovative researchers and capable developers on blockchain and AI. We were classmates when we studied at CMU and teammates when we particpated in hackthons. We all have strong passion, great ambitions, and rich experiences on AI and Web3 entrepreneurship for a better future digital new cyberspace. We previously partnered to finish several industry projects on MEV and sharding together successfully.

MEV project: https://drive.google.com/file/d/1HndMKl2LIIM-uCcjygpexDigRamKlM9W/view?usp=sharing

Sharding project: https://drive.google.com/file/d/1qfXJbMMMOh37ALL-zeeYR2uH2dpKiTm-/view?usp=sharing

## Development Status :open_book:

We have finished our technical research with our research paper, and we have submitted it for publication in academic journals. We are also designing the technical solution of our project and developing a demo in Polkadot. Overview of our solution: https://drive.google.com/file/d/1EWbTAZN_3NaqhrQ0NhwqK8LsDWmkRRK6/view?usp=sharing

## Development Roadmap :nut_and_bolt:

### Overview

- **Total Estimated Duration:** 7 months
- **Full-Time Equivalent (FTE):** 2 FTE
- **Total Costs:** $24,000

### Milestone 1 Project Development I

- **Estimated duration:** 2 months
- **FTE:** 3
- **Costs:** 6,000 USD

| Number | Deliverable | Specification |
| -----: | ----------- | ------------- |
| **0a.** | License | Apache 2.0 |
| **0b.** | Documentation | We will provide both **inline documentation** of the code and a basic **tutorial** that explains how a user can (for example) spin up one of our Substrate nodes and send test transactions, which will show how the project works. |
| **0c.** | Testing and Testing Guide | Core functions will be fully covered by comprehensive unit tests to ensure functionality and robustness. In the guide, we will describe how to run these tests to better contribute to the research and development work of our project. |
| **0d.** | Docker | We will provide a Dockerfile(s) that can be used to test all the functionalities delivered with this milestone |
| **0e.** | Article | We will publish an article and hold a workshop that explains our prjoect development work in English online |
| 1. | Substrate modules | We will create Substrate modules for the first and second core functionalities listed in Project Component part. We will finish the first functionality "Public AI improvement, auditing, and consensus" and start working on the second one. |
| 2. | Substrate chain | We will build a new MEV compatible Substrate chain to load our project and match the first and second core functionalities. |
| 3. | High-fidelity prototype | We will start building user-friendly interfaces and UI&UX design rationale for users to use our project easily |
| 4. | Smart contracts | We will deliver a set of ink! smart contracts for the first and second core functionalities as the source code of our project |

### Milestone 2 Project Development II

- **Estimated duration:** 2 months
- **FTE:** 3
- **Costs:** 6,000 USD

| Number | Deliverable | Specification |
| -----: | ----------- | ------------- |
| **0a.** | License | Apache 2.0 |
| **0b.** | Documentation | We will provide both **inline documentation** of the code and a basic **tutorial** that explains how a user can (for example) spin up one of our Substrate nodes and send test transactions, which will show how the project works. |
| **0c.** | Testing and Testing Guide | Core functions will be fully covered by comprehensive unit tests to ensure functionality and robustness. In the guide, we will describe how to run these tests to better contribute to the research and development work of our project. |
| **0d.** | Docker | We will provide a Dockerfile(s) that can be used to test all the functionalities delivered with this milestone |
| **0e.** | Article | We will publish an article and hold a workshop that explains our prjoect development work in English online |
| 1. | Substrate modules | We will create Substrate modules for the second and third core functionalities listed in Project Component part. We will finish the second and third functionalities "Decentralized AI modeling and training using privacy-preserving data" and "Trustworthy verification of AI execution results". |
| 2. | Substrate chain | We will build a new MEV compatible Substrate chain to load our project and match the second and third core functionalities. |
| 3. | High-fidelity prototype | We will start building user-friendly interfaces and UI&UX design rationale for users to use our project easily |
| 4. | Smart contracts | We will deliver a set of ink! smart contracts for the second and third core functionalities as the source code of our project |

### Milestone 3 Project Testing

- **Estimated Duration:** 1 month
- **FTE:** 4
- **Costs:** 6,000 USD

| Number | Deliverable | Specification |
| -----: | ----------- | ------------- |
| **0a.** | License | Apache 2.0 |
| **0b.** | Documentation | We will provide both **inline documentation** of the code and a basic **tutorial** that explains how a user can (for example) spin up one of our Substrate nodes and send test transactions, which will allow users to participant in the testing of our project. |
| **0c.** | Testing and Testing Guide | Core functions will be fully covered by comprehensive unit tests to ensure functionality and robustness. In the guide, we will describe how to run these tests to validate and improve our project. |
| **0d.** | Docker | We will provide a Dockerfile(s) that can be used to test all the functionalities delivered with this milestone |
| 1. | Substrate modules | We will create Substrate modules to test the core functionalites and features of our project listed in the grant proposal |
| 2. | Substrate chain | We will test the new MEV compatible Substrate chain used for loading and running our project |
| 3. | High-fidelity prototype | We will also test and evaluate the user-friendly interfaces and UI&UX design rationale of our project |
| 4. | Smart contracts | We will deliver a set of ink! smart contracts as the source code for testing our project |

### Milestone 4 Project Implementation

- **Estimated Duration:** 1 month
- **FTE:** 5
- **Costs:** 3,000 USD

| Number | Deliverable | Specification |
| -----: | ----------- | ------------- |
| **0a.** | License | Apache 2.0 |
| **0b.** | Documentation | We will provide both **inline documentation** of the code and a basic **tutorial** that explains how a user can (for example) spin up one of our Substrate nodes and send test transactions, which will allow users to participant in the implementation of our project. |
| **0c.** | Testing and Testing Guide | Core functions will be fully covered by comprehensive unit tests to ensure functionality and robustness. In the guide, we will describe how to run these tests for our project implementation. |
| **0d.** | Docker | We will provide a Dockerfile(s) that can be used to implement all the functionalities delivered with this milestone |
| 1. | Use cases | We will design and provide specific runnable applications of our project in different fields |
| 2. | Project report | We will provide our in-depth theroetical analysis and innovative solution on blocckhain and AI to conclude our project |
| 3. | Development plan | We will provide the sustainable and continuous future development plan of our project in the long-term |
| 4. | Smart contracts | We will deliver a set of ink! smart contracts as the source code for implementing our project |

### Milestone 5 Project Development

- **Estimated Duration:** 1 month
- **FTE:** 5
- **Costs:** 3,000 USD

| Number | Deliverable | Specification |
| -----: | ----------- | ------------- |
| **0a.** | License | Apache 2.0 |
| **0b.** | Documentation | We will provide both **inline documentation** of the code and a basic **tutorial** that explains how a user can (for example) spin up one of our Substrate nodes and send test transactions, which will allow users to participant in the implementation of our project. |
| **0c.** | Testing and Testing Guide | Core functions will be fully covered by comprehensive unit tests to ensure functionality and robustness. In the guide, we will describe how to run these tests for our project implementation. |
| **0d.** | Docker | We will provide a Dockerfile(s) that can be used to implement all the functionalities delivered with this milestone |
| 1. | Use cases | We will continue running and improving our project especially the specifc applications of as our use cases |
| 2. | Community | We will build and operate our community to attract and preserve users in different media and channels like Discord, Telegram, and Twitter. |
| 3. | Ecosystem | We will maintain and expand our open and decentralized AI ecosystem to appeal and benefit all kinds of stakeholders in our project including data contributor, algorithm improver, computation power provider, and AI application developer. |
| 4. | Business | We make our business model, marketing strategies, and operation plan to promote and develop our project in the long term in a profitable, sustainable and competitive way. |

## Future Plans

- In the short term we will continue doing our research, improving our design, and developing the first version of our project until it's released.
- In the long-term we will hire more talents to join, develop more use cases, build our ecosystem and better merge with Polkadot community.


## Additional Information :heavy_plus_sign:

We also gain support and guidance from industry partners and academic researchers on blockchain and AI from top universities and research centers. We have built several industry and research projects successfully on blockchain and AI. Our projects previously won the research grants from Ethereum Foundation, Ripple and Metagov.