dbsync icon indicating copy to clipboard operation
dbsync copied to clipboard

How to run this module as i m not comfortable with GO .Pls explain me.This module help me alot if i m able to run

Open sidharathjain2 opened this issue 3 years ago • 4 comments

sidharathjain2 avatar Apr 20 '22 11:04 sidharathjain2

The easier way to get started

  • install endly (for secret encryption used by dbsync)
    • see https://github.com/viant/endly/tree/master/doc/secrets
    • see db connection configuration details https://github.com/viant/dsc/tree/master/docs
  • boostrap docker-compose
  • build your sync rule and test it with curl --data-binary @request.yaml -X POST -H "Content-Type: application/yaml" http://syncEndpoint/v1/api/sync
  • convert tested rule into scheduled rule

Hope it helps

adranwit avatar Apr 20 '22 14:04 adranwit

can we use this module with MSSQL, the main purpose of my use is I have a MSSQL database and I want to synchronize the database as per day so that I can use it as a backup server while my other server is under maintenance I m second-year student . I have not much experience how to deal with this .

On Wed, Apr 20, 2022 at 8:31 PM Sidharath Jain @.***> wrote:

Thanks for reply. I will try these steps.if there is some problem i will ask you again.

On Wed, Apr 20, 2022, 8:24 PM adranwit @.***> wrote:

The easier way to get started

  • install endly (for secret encryption used by dbsync)
    • see https://github.com/viant/endly/tree/master/doc/secrets
    • see db connection configuration details https://github.com/viant/dsc/tree/master/docs
  • boostrap docker-compose
  • build your sync rule and test it with curl --data-binary @request.yaml -X POST -H "Content-Type: application/yaml" http://syncEndpoint/v1/api/sync
  • convert tested rule into scheduled rule

Hope it helps

— Reply to this email directly, view it on GitHub https://github.com/viant/dbsync/issues/2#issuecomment-1104028803, or unsubscribe https://github.com/notifications/unsubscribe-auth/APHKQT34IVK2FEPUFJZHUVDVGALBNANCNFSM5T3XQ5GA . You are receiving this because you authored the thread.Message ID: @.***>

sidharathjain2 avatar Apr 20 '22 17:04 sidharathjain2

this tool is most suitable to synchronize tables across various database vendors like MySQL and BigQuery or MSSQL, if you have hundreds of tables to sync or want to sync with the same vendor there might be better tools,

for example to sync MSSQL to BigQuery you can use the following rule:

table: MyTable `diff: Depth: 1 Columns: - Name: MODIFIED Func: SUM

source: datastore: myDatabase driverName: sqlserver descriptor: 'sqlserver://[username]:[password]@dbHost?database=[dbname]' parameters: dbname: myDatabase credentials: my-mssql-endly-secret positionReference: true pseudoColumns: - name: MODIFIED expression: CAST(DATEDIFF(s, '1970-01-01 00:00:00', t.CreateDate) AS BIGINT)

dest: table: MyDestTable driverName: bigquery credentials: my-google-secrets positionReference: true parameters: datasetId: MyDataSet pseudoColumns: - name: MODIFIED expression: UNIX_SECONDS(t.CreateDate) `

check yaml format correctnes

adranwit avatar Apr 20 '22 17:04 adranwit

Thanks for reply. I will try these steps.if there is some problem i will ask you again.

On Wed, Apr 20, 2022, 8:24 PM adranwit @.***> wrote:

The easier way to get started

  • install endly (for secret encryption used by dbsync)
    • see https://github.com/viant/endly/tree/master/doc/secrets
    • see db connection configuration details https://github.com/viant/dsc/tree/master/docs
  • boostrap docker-compose
  • build your sync rule and test it with curl --data-binary @request.yaml -X POST -H "Content-Type: application/yaml" http://syncEndpoint/v1/api/sync
  • convert tested rule into scheduled rule

Hope it helps

— Reply to this email directly, view it on GitHub https://github.com/viant/dbsync/issues/2#issuecomment-1104028803, or unsubscribe https://github.com/notifications/unsubscribe-auth/APHKQT34IVK2FEPUFJZHUVDVGALBNANCNFSM5T3XQ5GA . You are receiving this because you authored the thread.Message ID: @.***>

sidharathjain2 avatar Oct 11 '22 07:10 sidharathjain2