Skip to content

Latest commit

 

History

History
47 lines (36 loc) · 2.64 KB

README.md

File metadata and controls

47 lines (36 loc) · 2.64 KB

MongoDB Compatibilty Test

In this scenario, we are performing a MongoDB API test aimed at verifying compatibility, reliability, and performance across different implementations of the MongoDB document model. It's important to note that our focus is on the core product itself, and we are not evaluating or testing specific cloud providers. The purpose of this test is to validate the behavior of the MongoDB API when interacting with various MongoDB clones, taking into consideration potential differences in their underlying architecture or features.

Prerequisites:

Instructions

Clone Repos

  • git clone https://github.com/mongodb-developer/mongo-core-test.git
  • cd mongo-core-test
  • git clone https://github.com/mongodb/mongo.git

Run Tests

  • Edit run.py "User Variables"
  • python3 run.py [5, 7 or 8]

Optional Instructions To Create Test Environment

Use MongoDB 5.0.30 Docker Container:

  • docker compose -f mongo5.yml up -d

Use MongoDB 7.0.11 Docker Container:

  • docker compose -f mongo7.yml up -d

Use MongoDB 8.0.4 Docker Container:

  • docker compose -f mongo8.yml up -d

Use MariaDB MaxScale Docker Container:

  • docker compose -f maxscale.yml up -d

Use FerretDB 1.24 Docker Container:

  • docker compose -f ferret.yml up -d

Compatibilty Results By MongoDB Version

Product Tested vs MongoDB 5.x vs MongoDB 7.x vs MongodB 8.x Works with Compass
MongoDB 5 100% 96.01% 94.39% ✔️
MongoDB 7 100% 100% 98.20% ✔️
MongoDB 8 100% 100% 100% ✔️
Oracle 23ai 35.43% 34.28% 33.78% ✔️
SingleStore Kai 46.96% 45.85% N/A ✔️
FerretDB 1.24 37.42% 36.34% 34.60%
MaxScale 25.01.1 35.18% 33.88% 33.40%