I am getting BAD REQUEST (400) when I am trying to connect to any url ex:
http://0.0.0.0:5000/api/v1/news/
. What are the steps to resolve this?
Output of ./manage.sh up
Creating infrastructure...
Recreating mongo ... done
MongoDB shell version v4.2.17
connecting to: mongodb://localhost:27017/rss_news?compressors=disabled&gssapiServiceName=mongodb
Implicit session: session { "id" : UUID("59975a30-4c37-429f-a574-f5178dc7f588") }
MongoDB server version: 4.2.17
"ok" : 0,
"errmsg" : "command replSetInitiate requires authentication",
"code" : 13,
"codeName" : "Unauthorized"
Initiated replica set
MongoDB shell version v4.2.17
connecting to: mongodb://localhost:27017/admin?compressors=disabled&gssapiServiceName=mongodb
Implicit session: session { "id" : UUID("22b505ad-c940-46bf-ba2b-2620b4bacd36") }
MongoDB server version: 4.2.17
2021-10-11T04:28:05.628+0000 E QUERY [js] uncaught exception: Error: couldn't add user: command createUser requires authentication :
_getErrorWithCode@src/mongo/shell/utils.js:25:13
DB.prototype.createUser@src/mongo/shell/db.js:1413:11
@(shell):1:1
2021-10-11T04:28:05.628+0000 E QUERY [js] uncaught exception: Error: command grantRolesToUser requires authentication :
_getErrorWithCode@src/mongo/shell/utils.js:25:13
DB.prototype.grantRolesToUser@src/mongo/shell/db.js:1635:15
@(shell):1:1
MongoDB shell version v4.2.17
connecting to: mongodb://localhost:27017/admin?compressors=disabled&gssapiServiceName=mongodb
Implicit session: session { "id" : UUID("0e95023f-9a00-4201-8a07-7f13608ed26b") }
MongoDB server version: 4.2.17
"ok" : 0,
"errmsg" : "not master",
"code" : 10107,
"codeName" : "NotWritablePrimary"
2021-10-11T04:28:05.745+0000 E QUERY [js] uncaught exception: Error: couldn't add user: not master :
_getErrorWithCode@src/mongo/shell/utils.js:25:13
DB.prototype.createUser@src/mongo/shell/db.js:1413:11
@(shell):1:1
Recreating postgres ...
Recreating postgres ... done
Recreating elasticsearch ... done
Recreating zookeeper ... done
Creating minio ... done
Recreating redis ... done
Recreating airflow ... done
Recreating api ... done
Recreating proxy ... done
Recreating kafka ... done
Recreating schema-registry ... done
Recreating connect ... done
OUTPUT of docker ps command:
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
0bc8ef3be938 dataengineeringproject_connect "./register_connecto…" 40 seconds ago Up 39 seconds (health: starting) 0.0.0.0:8083->8083/tcp, 9092/tcp connect
11abb03946fb confluentinc/cp-schema-registry:5.3.1 "/etc/confluent/dock…" 41 seconds ago Up 40 seconds 8081/tcp schema-registry
96ffc1d68f8b dataengineeringproject_kafka "./create_default_to…" 41 seconds ago Up 40 seconds 9092/tcp kafka
cf36bccafb4b dataengineeringproject_proxy "/docker-entrypoint.…" 42 seconds ago Up 40 seconds 0.0.0.0:5000->5000/tcp, 8080/tcp proxy
49266edc8a5f dataengineeringproject_api "./run_api.sh" 42 seconds ago Up 42 seconds api
3f776a6022ed dataengineeringproject_airflow "/entrypoint.sh webs…" 43 seconds ago Up 41 seconds (healthy) 5555/tcp, 8793/tcp, 0.0.0.0:8080->8080/tcp airflow
2bfc84caa93f redis:alpine "docker-entrypoint.s…" 43 seconds ago Up 40 seconds 0.0.0.0:6379->6379/tcp redis
ada4f43e8a2e confluentinc/cp-zookeeper:5.3.1 "/etc/confluent/dock…" 43 seconds ago Up 41 seconds 2888/tcp, 0.0.0.0:2181->2181/tcp, 3888/tcp zookeeper
d9e5f3169391 dataengineeringproject_elasticsearch "/tini -- /usr/local…" 43 seconds ago Up 42 seconds 0.0.0.0:9200->9200/tcp, 9300/tcp elasticsearch
d9ce588ea654 postgres:9.6 "docker-entrypoint.s…" 43 seconds ago Up 42 seconds 5432/tcp postgres
bbb7edd6cf8d mongo:4.2 "docker-entrypoint.s…" 55 seconds ago Up 54 seconds 0.0.0.0:27017->27017/tcp mongo
The health of "connect" container is showing "starting" event after 5 min from start.
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
829efb7e52d0 dataengineeringproject_connect "./register_connecto…" 5 minutes ago Up 5 minutes (health: starting) 0.0.0.0:8083->8083/tcp, 9092/tcp connect
Logs of this container are below:
... 24 more
[2021-10-11 18:33:00,714] ERROR WorkerSinkTask{id=s3-minio-sink-0} Task is being killed and will not recover until manually restarted (org.apache.kafka.connect.runtime.WorkerTask)
[2021-10-11 18:33:06,214] INFO Checking current members of replica set at rs0/mongo:27017 (io.debezium.connector.mongodb.ReplicaSetDiscovery)
[2021-10-11 18:33:36,214] INFO Checking current members of replica set at rs0/mongo:27017 (io.debezium.connector.mongodb.ReplicaSetDiscovery)
[2021-10-11 18:33:38,803] INFO WorkerSourceTask{id=mongo-dbz-source-0} Committing offsets (org.apache.kafka.connect.runtime.WorkerSourceTask)
[2021-10-11 18:33:38,805] INFO WorkerSourceTask{id=mongo-dbz-source-0} flushing 0 outstanding messages for offset commit (org.apache.kafka.connect.runtime.WorkerSourceTask)
[2021-10-11 18:33:38,839] INFO WorkerSourceTask{id=mongo-dbz-source-0} Finished commitOffsets successfully in 35 ms (org.apache.kafka.connect.runtime.WorkerSourceTask)
[2021-10-11 18:34:06,214] INFO Checking current members of replica set at rs0/mongo:27017 (io.debezium.connector.mongodb.ReplicaSetDiscovery)
Hi, I've done updates to the Docker images and Python code.
First of all this infrastructure is quite heavy, so you must allocate a minimum of 8 GB of Docker memory resource.
Secondly, API is available on http:/127.0.0.1:5000/api/v1/news or http://localhost:5000/api/v1/news/.
