Oracle GoldenGate 之 SqlServer数据同步到Mysql数据库

项目描述：

将SqlSever 2008 R2中的数据实时或定时的同步到Mysql 5.6数据库中。

	OS	DATABASE
来源数据库	Window 2008	MS SQL 2008 R2
目标数据库	Linux	MySQL 5.6

实施方案：

如何初始化数据？

Navicat  Premium--可以很方便的将MSSQL SERVER中的数据结构和数据初始化到Mysql数据库中。

如何实现实时同步？

方案1：SyncNavigator--实现MSSQL SERVER和Mysql数据库之间的数据同步（可选在调度时间和机制）。

方案2：Oracle Goldengate--灵活的实现MSSQL SERVER和Mysql数据库之间的数据同步。

两种方案的利弊？

方案1:，配置简单，但是对于目标端表中已经存在数据的情况处理麻烦（无法创建同步字段，这个字段是软件同步进程需要的）

方案2，配置复杂，效率高。

使用OGG来实现MSSQL SERVER和MYSQL之间的数据同步

OGG 软件：

V34020-01

Oracle GoldenGate V11.2.1.0.2 for SQL Server on Windows (64bit)
V32399-01

Oracle GoldenGate V11.2.1.0.1 for MySQL 5.x on Linux x86-64)

源端MSSQL SERVER配置

安装OGG

C:\OGG>ggsci

Oracle GoldenGate Command Interpreter for SQL Server
Version 11.2.1.0.2 OGGCORE_11.2.1.0.2T3_PLATFORMS_120724.2205
Windows x64 (optimized), Microsoft SQL Server on Jul 25 2012 03:04:52

Copyright (C) 1995, 2012, Oracle and/or its affiliates. All rights reserved.



GGSCI (WIN-UGCMTTOTKE7) 1> create subdirs

Creating subdirectories under current directory C:\OGG

Parameter files                C:\OGG\dirprm: already exists
Report files                   C:\OGG\dirrpt: created
Checkpoint files               C:\OGG\dirchk: created
Process status files           C:\OGG\dirpcs: created
SQL script files               C:\OGG\dirsql: created
Database definitions files     C:\OGG\dirdef: created
Extract data files             C:\OGG\dirdat: created
Temporary files                C:\OGG\dirtmp: created
Stdout files                   C:\OGG\dirout: created

GGSCI (WIN-UGCMTTOTKE7) 2>exit

退出后，切换到OGG目录下

C:\OGG>INSTALL ADDSERVICE
Service 'GGSMGR' created.

Install program terminated normally.
C:\OGG>

配置ODBC数据源

Microsoft SQL Server ODBC 驱动程序版本 06.01.7601


数据源名称: oa_test
数据源描述: 
服务器: WIN-UGCMTTOTKE7
数据库: (Default)
语言: (Default)
翻译字符数据: Yes
日志长运行查询: No
日志驱动程序统计: No
使用区域设置: No
预定义的语句选项: 在断开时删除临时存储过程
使用故障转移服务器: No
使用 ANSI 引用的标识符: Yes
使用 ANSI 的空值，填充和警告: Yes
数据加密: No

配置OGG抽取进程

GGSCI (WIN-UGCMTTOTKE7) 8> dblogin sourcedb oa_test,userid yunwei,password "********"

2014-07-21 14:39:28  INFO    OGG-03036  Database character set identified as windows-936. Locale: zh_Hans_CN

2014-07-21 14:39:28  INFO    OGG-03037  Session character set identified as GBK.
Successfully logged into database.

GGSCI (WIN-UGCMTTOTKE7) 12> add trandata dbo.TEmployees


2014-07-21 14:43:51  WARNING OGG-01483  The key for table [oa_test.dbo.TEmployees] contains one or more variable length
columns.  These columns may not have their pre-images written to the transaction log during updates.  Please use KEYCOLS
 to specify a key for Oracle GoldenGate to use on this table.


Logging of supplemental log data is enabled for table dbo.TEmployees


GGSCI (WIN-UGCMTTOTKE7) 13> add trandata dbo.TRecords


2014-07-21 14:46:04  WARNING OGG-01483  The key for table [oa_test.dbo.TRecords] contains one or more variable length co
lumns.  These columns may not have their pre-images written to the transaction log during updates.  Please use KEYCOLS to specify a key for Oracle GoldenGate to use on this table.


Logging of supplemental log data is enabled for table dbo.TRecords


GGSCI (WIN-UGCMTTOTKE7) 14> edit params oa

编辑如下内容：

defsfile c:\ogg\dirdef\oa.def
sourcedb oa_test,userid yunwei,password "******"
table dbo.TEmployees;
table dbo.TRecords;

执行生成表结构定义文件

C:\OGG>defgen paramfile c:\ogg\dirprm\oa.prm

将新生成的def文件拷贝到目标端！

查看mssql数据库处于完全恢复模式。

GGSCI (WIN-UGCMTTOTKE7) 3> edit param mgr

填写如下内容：
port 7809

GGSCI (WIN-UGCMTTOTKE7) 5> start mgr

Starting Manager as service ('GGSMGR')...
Service started.

GGSCI (WIN-UGCMTTOTKE7) 8> info all

Program     Status      Group       Lag at Chkpt  Time Since C
MANAGER     RUNNING

GGSCI (WIN-UGCMTTOTKE7) 9> add extract emssql,tranlog,begin now
EXTRACT added.

GGSCI (WIN-UGCMTTOTKE7) 10> add rmttrail ./dirdat/ms,extract emssql
RMTTRAIL added.

GGSCI (WIN-UGCMTTOTKE7) 11> edit params emssql

编辑内容如下：

EXTRACT EMSSQL
SOURCEDB oa_test,userid yunwei,password "******"
TRANLOGOPTIONS MANAGESECONDARYTRUNCATIONPOINT
RMTHOST 192.168.2.34, MGRPORT 7809
RMTTRAIL ./dirdat/ms
TABLE dbo.TEmployees;
TABLE dbo.TRecords;

执行全库备份。然后启动进程。并且 trunc. log on chkpt要设置为false

目标端MYSQL配置：

安装：

可参考mysql版本的OGG安装步骤，大同小异

配置复制进程：

GGSCI (localhost.localdomain) 2> dblogin sourcedb [email protected]:3306,userid root,password xxxx
Successfully logged into database.

GGSCI (localhost.localdomain) 3> add replicat rmysql,exttrail ./dirdat/ms,nodbcheckpoint
REPLICAT added.

GGSCI (localhost.localdomain) 4> edit params rmysql

填写如下内容：

replicat rmysql
TARGETDB [email protected]:3306,userid root,password xxx
assumetargetdefs
sourcedefs ./dirdef/oa.def
reperror default,discard
discardfile ./dirrpt/rmysql.dsc,append,megabytes 100

MAP dbo.TEmployees,TARGET oa.temployees,keycols(Employee_ID);
MAP dbo.TRecords,TARGET oa.trecords,keycols(Record_ID),colmap(usedefaults,RinOut=inOut);

至此！配置完成。

接下来就是进行insert update delete测试。

小插曲：

Sql  server表中的bit数据类型在抓换到mysql中时为bool（tinyint）类型，这时候ogg会报错，提示类型不匹配。需要手动将mysql中的相关类型设置为char(1)就OK了。