link管理
链接快照平台
- 输入网页链接，自动生成快照
- 标签化管理网页链接
相关文章推荐
|
要出家的足球 · Docker Compose 快速部署 | ...· 1 月前 · |
|
|
踏实的碗 · Maxkit: mongodb 帳號驗證權限· 1 月前 · |
|
|
温文尔雅的圣诞树 · DAY25 MongoDB ...· 1 月前 · |
|
|
谦和的炒粉 · MongoDB数据库用户角色与权限管理 | ...· 1 月前 · |
|
|
刀枪不入的马铃薯 · mongodb "errmsg" : ...· 1 月前 · |
|
|
耍酷的毛豆 · 北京市小客车指标管理信息系统· 2 月前 · |
|
|
沉稳的红薯 · AutoCAD ...· 1 年前 · |
|
|
博学的乌冬面 · 精灵训练师小游戏 - 抖音· 2 年前 · |
|
|
不爱学习的甘蔗 · 比亚迪唐EV比Model ...· 2 年前 · |
|
|
玩命的拖把 · 袁宝璟老婆和丽丽的关系 - 抖音· 2 年前 · |
link管理
›
Create a Debezium source connector from MongoDB to Apache Kafka® - Aiven
| postgresql toggle kafka mongodb |
| https://docs.aiven.io/docs/products/kafka/kafka-connect/howto/debezium-source-connector-mongodb |
|
卖萌的饼干
2 年前 |
- Set up AWS Marketplace subscriptions
- Set up Azure Marketplace subscriptions
- Set up Google Cloud Marketplace subscriptions
- Aiven Console overview
- Feature previews
-
Organizations, units, and projects
- Organization hierarchy and access
- Create organizations and organizational units
- Manage projects
- Project member roles
- Manage unassigned projects
-
Billing and payments
- Billing overview
- Corporate billing
- Tax information for Aiven services
- Update your tax status
-
Payment methods
- Manage payment cards
-
Marketplace subscriptions
- Move to AWS Marketplace
- Move to Azure Marketplace
- Move to Google Cloud Marketplace
-
Billing groups
- Billing groups overview
- Create billing groups
- Manage billing groups
- Assign projects to billing groups
- Change billing contacts
- Payment problems when upgrading
- Request service custom plans
-
User and access management
- Manage users in an organization
-
User profiles
- Edit your user profile
- Change your email address
-
Authentication methods
- Add authentication methods
- Password policy
- Manage two-factor authentication
- Authentication tokens
- Create authentication tokens
-
SAML authentication
- Set up SAML authentication
- Set up SAML with Auth0
- Set up SAML with Microsoft Azure Active Directory
- Set up SAML with FusionAuth
- Set up SAML with JumpCloud
- Set up SAML with Okta
- Set up SAML with OneLogin
- Set up SAML with Google
-
Service management
- Choosing a time series database
- Create a new service
- Rename a service
- Tag your Aiven resources
- Search for services
- Recover a deleted service
- Create service users
- Service forking
- Fork your service
- Backups at Aiven
- Service power cycle
- Pause or terminate your service
- Service resources
- Service memory limits
- Out of memory conditions
- Prepare services for high load
- Scale your service
- Dynamic Disk Sizing (DDS)
- Periodic cleanup of powered-off services
- Add or remove storage
- Access service logs
- Access service metrics
- Migrate service to another cloud or region
- Migrate a public service to a Virtual Private Cloud (VPC)
- EOL for major versions of Aiven Services
- Maintenance window
-
Networking and security
- List of available cloud regions
- Availability zones
-
BYOC
- Bring your own cloud (BYOC)
- Create custom cloud
- Assign projects
- Add customer contacts
- Rename custom cloud
- Enhanced compliance environments (ECE)
- Firewall configuration for service nodes
- Cloud security
- Disaster recovery testing scenarios
- TLS/SSL certificates
- Download CA certificates
- Restrict network access to services
- Enable public access in VPCs
- Static IP addresses
- Default service IP address and hostname
- Manage static IP addresses
- Handle resolution errors of private IP addresses
- Attach VPCs to an AWS Transit Gateway
- Manage Virtual Private Cloud (VPC) peering
- Set up Virtual Private Cloud (VPC) peering on Google Cloud Platform (GCP)
- Set up Virtual Private Cloud (VPC) peering on AWS
- Set up Azure virtual network peering
- Use AWS PrivateLink with Aiven services
- Use Azure Private Link with Aiven services
- Use Google Private Service Connect with Aiven services
-
Monitoring and logs
- Monitoring services
- About logging, metrics and alerting
-
Amazon CloudWatch
- CloudWatch metrics
-
CloudWatch Logs
- Send logs to AWS CloudWatch from Aiven web console
- Send logs to AWS CloudWatch from Aiven client
-
Datadog
- Send metrics to Datadog
- Increase metrics limit setting for Datadog
- Send logs to Datadog
- Add custom tags Datadog integration
- Elasticsearch logs
- Google Cloud Logging
- Google BigQuery
-
RSyslog
- Logtail
- Loggly
- Jolokia metrics
-
Prometheus metrics
- Prometheus system metrics
-
Integrations
- Service integrations
- Create service integrations
-
Aiven tools
-
Aiven CLI
-
avn account-
avn account authentication-method -
avn account team -
avn billing-group -
avn card -
avn cloud -
avn credits -
avn events -
avn mirrormaker -
avn project -
avn service-
avn service acl -
avn service connection-info -
avn service connection-pool -
avn service connector -
avn service database -
avn service es-acl -
avn service flink -
avn service integration -
avn service m3 -
avn service privatelink -
avn service schema-registry-acl -
avn service index -
avn service tags -
avn service topic -
avn service user -
avn ticket -
avn user-
avn user access-token -
avn vpc -
Aiven API
- API examples
-
Aiven Terraform provider
- Get started
-
HowTo
- Enable debug logging
- Upgrade the Aiven Terraform Provider from v1 to v2
- Upgrade the Aiven Terraform Provider from v2 to v3
- Upgrade the Aiven Terraform Provider from v3 to v4
- Update deprecated resources
- Use PostgreSQL provider alongside Aiven Terraform Provider
- Promote PostgreSQL read-only replica to master
- Upgrade to OpenSearch® with Terraform
- Azure virtual network peering
- GCP virtual network peering
- AWS virtual network peering
-
Concepts
- Data sources in Terraform
-
Reference
-
Aiven Terraform Cookbook
- Apache Kafka and OpenSearch
- Multicloud PostgreSQL
- Apache Kafka and Apache Flink
- Apache Kafka and Apache MirrorMaker
- Apache Kafka with Karapace
- Visualize PostgreSQL metrics with Grafana
- PostgreSQL with custom configs
- Apache Kafka MongoDB Source Connector
- Debezium Source Connector across clouds
- Apache Kafka with topics and HTTP sink connector
- Apache Kafka with custom configurations
- M3 and M3 Aggregator
- PostgreSQL® read-only replica
- Configure ClickHouse user's access
- Apache Kafka and ClickHouse
- ClickHouse and PostgreSQL
-
Troubleshooting
- Private access error when using VPC
- Access control lists and permission mapping
- Schema registry authorization
- Apache Kafka® REST API
- Compacted topics
- Partition segments
- Authentication types
-
NOT_LEADER_FOR_PARTITIONerrors - Configuration backups for Apache Kafka®
- Monitoring consumer groups in Aiven for Apache Kafka®
- Quotas
-
HowTo
-
Code samples
- Connect with Python
- Connect with Java
- Connect with Go
- Connect with command line
- Connect with NodeJS
-
Tools
- Configure properties for Apache Kafka® toolbox
-
Use
kcatwith Aiven for Apache Kafka® - Connect to Apache Kafka® with Conduktor
- Use Kafdrop Web UI with Aiven for Apache Kafka®
- Use Provectus® UI for Apache Kafka® with Aiven for Apache Kafka®
- Use Kpow with Aiven for Apache Kafka®
- Connect Aiven for Apache Kafka® with Klaw
-
Security
- Configure Java SSL keystore and truststore to access Apache Kafka
- Manage users and access control lists
- Monitor and alert logs for denied ACL
- Use SASL authentication with Aiven for Apache Kafka®
- Renew and Acknowledge service user SSL certificates
- Encrypt data using a custom serde
-
Administration tasks
-
Schema registry
- Use Karapace with Aiven for Apache Kafka®
- Get the best from Apache Kafka®
- Manage configurations with Apache Kafka® CLI tools
- Manage Apache Kafka® parameters
- View and reset consumer group offsets
- Configure log cleaner for topic compaction
- Prevent full disks
- Set Apache ZooKeeper™ configuration
-
Avoid
OutOfMemoryErrorerrors in Aiven for Apache Kafka® - Optimizing resource usage
- Manage quotas
-
Integrations
- Integration of logs into Apache Kafka® topic
- Use Apache Kafka® Streams with Aiven for Apache Kafka®
- Use Apache Flink® with Aiven for Apache Kafka®
- Configure Apache Kafka® metrics sent to Datadog
- Use ksqlDB with Aiven for Apache Kafka
-
Add
kafka.producer.andkafka.consumerDatadog metrics -
Topic/schema management
- Creating an Apache Kafka® topic
- Create Apache Kafka® topics automatically
- Get partition details of an Apache Kafka® topic
- Use schema registry in Java with Aiven for Apache Kafka®
- Change data retention period
-
Reference
- Advanced parameters
- Metrics available via Prometheus
-
Apache Kafka Connect
- Getting started
-
Concepts
- List of available Apache Kafka® Connect connectors
- JDBC source connector modes
- Causes of “connector list not currently available”
-
HowTo
-
Administration tasks
- Get the best from Apache Kafka® Connect
- Bring your own Apache Kafka® Connect cluster
- Enable Apache Kafka® Connect on Aiven for Apache Kafka®
- Enable Apache Kafka® Connect connectors auto restart on failures
- Manage Kafka Connect logging level
- Request a new connector
-
Source connectors
- PostgreSQL to Kafka
- PostgreSQL to Kafka with Debezium
- MySQL to Kafka
- MySQL to Kafka with Debezium
- SQL Server to Kafka
- SQL Server to Kafka with Debezium
- MongoDB to Kafka
- Handle PostgreSQL® node replacements when using Debezium for change data capture
- MongoDB to Kafka with Debezium
- Cassandra to Kafka
- MQTT to Kafka
- Google Pub/Sub to Kafka
- Google Pub/Sub Lite to Kafka
- Couchbase to Kafka
-
Sink connectors
- Kafka to another database with JDBC
- Configure AWS for an S3 sink connector
- Kafka to S3 (Aiven)
- Use AWS IAM assume role credentials provider
- Kafka to S3 (Confluent)
- Configure GCP for a Google Cloud Storage sink connector
- Kafka to GCS
- Configure GCP for a Google BigQuery sink connector
- Kafka to Big Query
- Kafka to OpenSearch
- Kafka to Elasticsearch
- Configure Snowflake for a sink connector
- Kakfa to Snowflake
- Kafka to HTTP
- Kafka to MongoDB
- Kafka to MongoDB (by Lenses)
- Kafka to InfluxDB
- Kafka to Redis
- Kafka to Cassandra
- Kafka to Couchbase
- Kafka to Google Pub/Sub
- Kafka to Google Pub/Sub Lite
- Kafka to Splunk
- Kafka to MQTT
-
Reference
- Advanced parameters
-
AWS S3 sink connector naming and data format
- S3 sink connector by Aiven naming and data formats
- S3 sink connector by Confluent naming and data formats
- Google Cloud Storage sink connector naming and data formats
- Metrics available via Prometheus
-
Apache Kafka MirrorMaker2
- Getting started
-
Concepts
-
Disaster recovery and migration
- Active-Active Setup
- Active-Passive Setup
- Topics included in a replication flow
- MirrorMaker 2 common parameters
-
HowTo
- Integrate an external Apache Kafka® cluster in Aiven
- Set up an Apache Kafka® MirrorMaker 2 replication flow
- Setup Apache Kafka® MirrorMaker 2 monitoring
- Remove topic prefix when replicating with Apache Kafka® MirrorMaker 2
-
Reference
- List of advanced parameters
- Known issues
- Terminology for Aiven for Apache Kafka® MirrorMaker 2
-
Karapace
- Getting started with Karapace
-
Concepts
- Karapace schema registry authorization
- ACLs definition
- Apache Kafka® REST proxy authorization
-
HowTo
- Enable Karapace schema registry and REST APIs
- Enable Karapace schema registry authorization
- Enable Apache Kafka® REST proxy authorization
- Manage Karapace schema registry authorization
- Manage Apache Kafka® REST proxy authorization
-
Apache Flink
-
Overview
- Architecture overview
- Aiven for Apache Flink features
- Managed service features
- Plans and pricing
- Limitations
- Quickstart
-
Concepts
- Aiven Flink applications
- Built-in SQL editor
- Flink tables
- Checkpoints
- Savepoints
- Event and processing times
- Watermarks
- Windows
- Standard and upsert connectors
- Settings for Apache Kafka® connectors
-
HowTo
- Get started
-
Integrate service
- Data service integrations
- Integrate with Apache Kafka
- Integrate with Google BigQuery
-
Aiven for Apache Flink applications
- Create Apache Flink applications
- Manage Apache Flink applications
-
Apache Flink tables
- Manage Apache Flink tables
-
Create Apache Flink tables with data sources
- Apache Kafka-based Apache Flink table
- Confluent Avro-based Apache Flink table
- PostgreSQL-based Apache Flink table
- OpenSearch-based Apache Flink table
- PostgreSQL CDC connector-based Apache Flink table
- Slack-based Apache Flink table
- DataGen-based Apache Flink table
-
HowTo
- Get started
-
Connect to service
- Connect with cqlsh
- Connect with Python
- Connect with Go
-
Manage service
- Manage data with DSBULK
- Stress test with nosqlbench
- Manage cluster
-
Cross-cluster replication
- Enable CCR
- Manage CCR
- Disable CCR
-
ClickHouse
-
Overview
- Features overview
- Architecture overview
- Plans and pricing
- Limits and limitations
- Quickstart
-
Concepts
- Online analytical processing
- ClickHouse® as a columnar database
- Indexing and data processing in ClickHouse®
- Disaster recovery
- Strings
-
HowTo
-
Get started
- Load data
- Secure a service
-
Connect to service
- Connect with the ClickHouse client
- Connect with Go
- Connect with Python
- Connect with Node.js
- Connect with PHP
- Connect with Java
-
Manage service
- Manage users and roles
- Manage user permissions with Terraform
- Manage databases and tables
- Query databases
- Create materialized views
- Monitor performance
- Read and write data across shards
- Copy data across ClickHouse servers
- Fetch query statistics
- Manage cluster
-
Integrate service
- Connect to Grafana
- Connect to Apache Kafka
- Connect to PostgreSQL
- Connect a service as a data source (Apache Kafka and PostgreSQL)
- Connect services via integration databases
- Connect to external DBs with JDBC
-
Reference
- Supported table engines
- ClickHouse metrics in Grafana
- Formats for ClickHouse-Kafka data exchange
- Advanced parameters
-
Grafana
-
Overview
- Features overview
- Plans and pricing
- Quickstart
-
HowTo
-
User access
- Log in to Aiven for Grafana
- Update Grafana® service credentials
- OAuth configuration
-
Manage dashboards
- Dashboard previews
- Replace strings in Grafana® dashboards
- Alerts and notifcations
- Manage cluster
- Point-in-time recovery process
-
Reference
- Advanced parameters
- Plugins
-
InfluxDB
- Get started
-
Concepts
- Continuous queries
- InfluxDB® retention policies
-
HowTo
- Migrate data from self-hosted InfluxDB® to Aiven
-
Reference
- Advanced parameters for Aiven for InfluxDB®
-
M3DB
- Get started
-
Concepts
- Aiven for M3 components
- About M3DB namespaces and aggregation
- About scaling M3
-
HowTo
- Visualize M3DB data with Grafana®
- Monitor Aiven services with M3DB
- Use M3DB as remote storage for Prometheus
- Write to M3 from Telegraf
- Telegraf to M3 to Grafana® Example
- Write data to M3DB with Go
- Write data to M3DB with PHP
- Write data to M3DB with Python
-
Reference
- Terminology
- Advanced parameters
- Advanced parameters M3Aggregator
-
HowTo
- Get started
-
Connect to a service
- Connect to Aiven for MySQL® from the command line
- Connect to Aiven for MySQL® with Python
- Connect to Aiven for MySQL® using MySQLx with Python
- Connect to Aiven for MySQL® with Java
- Connect to Aiven for MySQL® with PHP
- Connect to Aiven for MySQL® with MySQL Workbench
-
Database management
- Create a database
- Create remote replicas
- Backup and restore with mysqldump
- Disable foreign key checks
- Enable slow query logging
- Create new tables without primary keys
- Create missing primary keys
-
Data migration
- Run pre-migration checks
- Migrate to Aiven with CLI
- Migrate to Aiven via console
-
Disk space management
- Prevent running out of disk space
- Reclaim disk space
- Identify disk usage issues
- Cluster management
-
Reference
- Advanced parameters
- Resource capability per plan
-
OpenSearch
-
Quickstart
- Sample dataset: recipes
-
Overview
- Service overview
- Plans and pricing
-
Concepts
-
Access control
- Understanding access control in Aiven for OpenSearch®
-
OpenSearch Security
- Key considerations
- OpenSearch backups
- Indices
- Aggregations
- High availability in Aiven for OpenSearch®
- OpenSearch® vs Elasticsearch
- Optimal number of shards
- When to create a new index
- OpenSearch® cross-cluster replication
-
HowTo
-
Manage access control
- Manage users and access control in Aiven for OpenSearch®
-
Connect with service
- Connect with cURL
- Connect with NodeJS
- Connect with Python
-
Data management
-
Copy data from OpenSearch to Aiven for OpenSearch® using
elasticsearch-dump -
Copy data from Aiven for OpenSearch® to AWS S3 using
elasticsearch-dump - Migrate Elasticsearch data
-
Search and aggregation
- Search with Python
- Search with NodeJS
- Aggregation with NodeJS
-
Manage OpenSearch Security
- Enable OpenSearch Security management
- SAML authentication
- Audit logs
- OpenSearch Dashboard multi-tenancy
-
Manage service
- Restore an OpenSearch® backup
- Set index retention patterns
- Create alerts with OpenSearch® API
- Handle low disk space
- Manage large shards
- Cross-cluster replication
-
Integrate service
- Manage OpenSearch® log integration
- Integrate with Grafana®
-
Upgrade to OpenSearch
- Upgrade to OpenSearch®
- Upgrade Elasticsearch clients to OpenSearch®
-
OpenSearch Dashboards
- Getting started
-
HowTo
- Getting started with Dev tools
- Create alerts with OpenSearch® Dashboards
-
HowTo
-
Get started
- Load sample dataset
-
Connect to service
- Connect with Go
- Connect with Java
- Connect with NodeJS
- Connect with PHP
- Connect with Python
-
Connect with
psql - Connect with pgAdmin
- Connect with Rivery
- Connect with Skyvia
- Connect with Zapier
-
Administer database
- Create additional PostgreSQL® databases
- Perform a PostgreSQL® major version upgrade
- Install or update an extension
- Create manual PostgreSQL® backups
- Restore PostgreSQL® from a backup
- Claim public schema ownership
- Manage connection pooling
- Access PgBouncer statistics
-
Use the PostgreSQL®
dblinkextension -
Use the PostgreSQL®
pg_repackextension -
Use the PostgreSQL®
pg_cronextension - Enable JIT in PostgreSQL®
- Identify PostgreSQL® slow queries
- Detect and terminate long-running queries
- Optimize PostgreSQL® slow queries
- Check and avoid transaction ID wraparound
- Prevent PostgreSQL® full disk issues
- Enable and use pgvector
- Check size of a database, a table or an index
-
Migrate
- Migrate to a different cloud provider or region
-
Migrate to Aiven for PostgreSQL® with
aiven-db-migrate -
Migrate to Aiven for PostgreSQL® with
pg_dumpandpg_restore - Migrating to Aiven for PostgreSQL® using Bucardo
-
Migrate between PostgreSQL® instances using
aiven-db-migratein Python - Replicate
-
Get started
-
Copy data from OpenSearch to Aiven for OpenSearch® using
-
Manage access control
-
Access control
-
Quickstart
-
User access
-
Overview
-
Get started
-
Overview
-
Overview
-
Disaster recovery and migration
-
Administration tasks
-
Schema registry
-
Code samples
-
Aiven Terraform Cookbook
-
-
-
-
-
Aiven CLI