Mycat核心開發(fā)者帶你輕松掌握Mycat路由轉(zhuǎn)發(fā)??!
作者個(gè)人研發(fā)的在高并發(fā)場景下,提供的簡單、穩(wěn)定、可擴(kuò)展的延遲消息隊(duì)列框架,具有精準(zhǔn)的定時(shí)任務(wù)和延遲隊(duì)列處理功能。自開源半年多以來,已成功為十幾家中小型企業(yè)提供了精準(zhǔn)定時(shí)調(diào)度方案,經(jīng)受住了生產(chǎn)環(huán)境的考驗(yàn)。為使更多童鞋受益,現(xiàn)給出開源框架地址:https://github.com/sunshinelyz/mykit-delay
寫在前面
熟悉Mycat的小伙伴都知道,Mycat一個(gè)很重要的功能就是路由轉(zhuǎn)發(fā),那么,這篇文章就帶著大家一起來看看Mycat是如何進(jìn)行路由轉(zhuǎn)發(fā)的,好了,不多說了,我們直接進(jìn)入主題。
環(huán)境準(zhǔn)備
軟件版本
操作系統(tǒng):CentOS-6.8
JDK版本:jdk1.8
Mycat版本:Mycat-server-1.6
MySQL:5.7
注意:這里,我將Mycat和MySQL安裝在同一臺虛擬機(jī)(IP:192.168.209.140 主機(jī)名為:binghe140),大家也可以將Mycat和MySQL安裝到不同的主機(jī)上,測試效果是一樣的。
創(chuàng)建物理庫
- mysql -uroot -proot -h192.168.209.140 -P3306
- drop database if exists db1;
- create database db1;
- drop database if exists db2;
- create database db2;
- drop database if exists db3;
- create database db3;
配置Mycat
schema.xml配置
- <?xml version="1.0"?>
- <!DOCTYPE mycat:schema SYSTEM "schema.dtd">
- <mycat:schema xmlns:mycat="http://org.opencloudb/" >
- <schema name="binghe" checkSQLschema="false" sqlMaxLimit="100">
- <table name="travelrecord" dataNode="dn1,dn2,dn3" rule="auto-sharding-long"></table>
- </schema>
- <!-- <dataNode name="dn1$0-743" dataHost="localhost1" database="db$0-743"
- /> -->
- <dataNode name="dn1" dataHost="localhost1" database="db1" />
- <dataNode name="dn2" dataHost="localhost1" database="db2" />
- <dataNode name="dn3" dataHost="localhost1" database="db3" />
- <!--<dataNode name="dn4" dataHost="sequoiadb1" database="SAMPLE" />
- <dataNode name="jdbc_dn1" dataHost="jdbchost" database="db1" />
- <dataNode name="jdbc_dn2" dataHost="jdbchost" database="db2" />
- <dataNode name="jdbc_dn3" dataHost="jdbchost" database="db3" /> -->
- <dataHost name="localhost1" maxCon="1000" minCon="10" balance="0"
- writeType="0" dbType="mysql" dbDriver="native" switchType="1" slaveThreshold="100">
- <heartbeat>select user()</heartbeat>
- <!-- can have multi write hosts -->
- <writeHost host="hostM1" url="127.0.0.1:3306" user="root" password="root"></writeHost>
- <writeHost host="hostM2" url="127.0.0.1:3306" user="root" password="root"></writeHost>
- <!--<writeHost host="hostS1" url="localhost:3316" user="root"-->
- <!--password="123456" />-->
- <!-- <writeHost host="hostM2" url="localhost:3316" user="root" password="123456"/> -->
- </dataHost>
- </mycat:schema>
server.xml配置
- <?xml version="1.0" encoding="UTF-8"?>
- <!DOCTYPE mycat:server SYSTEM "server.dtd">
- <mycat:server xmlns:mycat="http://org.opencloudb/">
- <system>
- <property name="defaultSqlParser">druidparser</property>
- </system>
- <user name="binghe">
- <property name="password">binghe.123</property>
- <property name="schemas">binghe</property>
- </user>
- <user name="test">
- <property name="password">test</property>
- <property name="schemas">binghe</property>
- <property name="readOnly">true</property>
- </user>
- </mycat:server>
rule.xml配置
- <?xml version="1.0" encoding="UTF-8"?>
- <!DOCTYPE mycat:rule SYSTEM "rule.dtd">
- <mycat:rule xmlns:mycat="http://org.opencloudb/">
- <tableRule name="rule1">
- <rule>
- <columns>id</columns>
- <algorithm>func1</algorithm>
- </rule>
- </tableRule>
- <tableRule name="rule2">
- <rule>
- <columns>user_id</columns>
- <algorithm>func1</algorithm>
- </rule>
- </tableRule>
- <tableRule name="sharding-by-intfile">
- <rule>
- <columns>sharding_id</columns>
- <algorithm>hash-int</algorithm>
- </rule>
- </tableRule>
- <tableRule name="auto-sharding-long">
- <rule>
- <columns>id</columns>
- <algorithm>rang-long</algorithm>
- </rule>
- </tableRule>
- <tableRule name="mod-long">
- <rule>
- <columns>id</columns>
- <algorithm>mod-long</algorithm>
- </rule>
- </tableRule>
- <tableRule name="sharding-by-murmur">
- <rule>
- <columns>id</columns>
- <algorithm>murmur</algorithm>
- </rule>
- </tableRule>
- <tableRule name="sharding-by-month">
- <rule>
- <columns>create_date</columns>
- <algorithm>partbymonth</algorithm>
- </rule>
- </tableRule>
- <tableRule name="latest-month-calldate">
- <rule>
- <columns>calldate</columns>
- <algorithm>latestMonth</algorithm>
- </rule>
- </tableRule>
- <tableRule name="auto-sharding-rang-mod">
- <rule>
- <columns>id</columns>
- <algorithm>rang-mod</algorithm>
- </rule>
- </tableRule>
- <tableRule name="jch">
- <rule>
- <columns>id</columns>
- <algorithm>jump-consistent-hash</algorithm>
- </rule>
- </tableRule>
- <function name="murmur"
- class="org.opencloudb.route.function.PartitionByMurmurHash">
- <property name="seed">0</property>
- <property name="count">2</property>
- <property name="virtualBucketTimes">160</property>
- </function>
- <function name="hash-int"
- class="org.opencloudb.route.function.PartitionByFileMap">
- <property name="mapFile">partition-hash-int.txt</property>
- </function>
- <function name="rang-long"
- class="org.opencloudb.route.function.AutoPartitionByLong">
- <property name="mapFile">autopartition-long.txt</property>
- </function>
- <function name="mod-long" class="org.opencloudb.route.function.PartitionByMod">
- <!-- how many data nodes -->
- <property name="count">3</property>
- </function>
- <function name="func1" class="org.opencloudb.route.function.PartitionByLong">
- <property name="partitionCount">8</property>
- <property name="partitionLength">128</property>
- </function>
- <function name="latestMonth"
- class="org.opencloudb.route.function.LatestMonthPartion">
- <property name="splitOneDay">24</property>
- </function>
- <function name="partbymonth"
- class="org.opencloudb.route.function.PartitionByMonth">
- <property name="dateFormat">yyyy-MM-dd</property>
- <property name="sBeginDate">2020-01-01</property>
- </function>
- <function name="rang-mod" class="org.opencloudb.route.function.PartitionByRangeMod">
- <property name="mapFile">partition-range-mod.txt</property>
- </function>
- <function name="jump-consistent-hash" class="org.opencloudb.route.function.PartitionByJumpConsistentHash">
- <property name="totalBuckets">3</property>
- </function>
- </mycat:rule>
登錄Mycat
登錄Mycat
命令行輸入以下命令登錄Mycat
- D:\>mysql -ubinghe -pbinghe.123 -h192.168.209.140 -P8066
- Welcome to the MySQL monitor. Commands end with ; or \g.
- Your MySQL connection id is 2
- Server version: 5.5.8-mycat-1.6.1-RELEASE-20170807215126 MyCat Server (OpenCloundDB)
- Copyright (c) 2000, 2016, Oracle and/or its affiliates. All rights reserved.
- Oracle is a registered trademark of Oracle Corporation and/or its
- affiliates. Other names may be trademarks of their respective
- owners.
- Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
- mysql>
創(chuàng)建表測試
輸入以下命令查看創(chuàng)建表的路由
- create table travelrecord (id bigint not null primary key,user_id varchar(100),traveldate DATE, fee decimal,days int);
結(jié)果如下:
- mysql> explain create table travelrecord (id bigint not null primary key,user_id varchar(100),traveldate DATE, fee decimal,days int);
- +-----------+-----------------------------------------------------------------------------------------------------------------------+
- | DATA_NODE | SQL |
- +-----------+-----------------------------------------------------------------------------------------------------------------------+
- | dn1 | create table travelrecord (id bigint not null primary key,user_id varchar(100),traveldate DATE, fee decimal,days int) |
- | dn2 | create table travelrecord (id bigint not null primary key,user_id varchar(100),traveldate DATE, fee decimal,days int) |
- | dn3 | create table travelrecord (id bigint not null primary key,user_id varchar(100),traveldate DATE, fee decimal,days int) |
- +-----------+-----------------------------------------------------------------------------------------------------------------------+
- 3 rows in set (0.00 sec)
- mysql>
說明創(chuàng)建表的SQL語句被Mycat路由到dn1,dn2,dn3三個(gè)節(jié)點(diǎn)上,也就是說在3個(gè)節(jié)點(diǎn)上都執(zhí)行了創(chuàng)建表的SQL。
我們輸入建表語句:
- mysql> create table travelrecord (id bigint not null primary key,user_id varchar(100),traveldate DATE, fee decimal,days int);
- Query OK, 0 rows affected (0.18 sec)
此時(shí),將會在dn1,dn2,dn3三個(gè)節(jié)點(diǎn)上創(chuàng)建travelrecord表。
錄入數(shù)據(jù)測試
錄入到dn1節(jié)點(diǎn)
我們在命令行輸入如下SQL語句
- explain insert into travelrecord (id,user_id,traveldate,fee,days) values(100001,'binghe','2020-11-10',510.5,3);
結(jié)果如下:
- mysql> explain insert into travelrecord (id,user_id,traveldate,fee,days) values(100001,'binghe','2017-08-07',510.5,3);
- +-----------+-------------------------------------------------------------------------------------------------------------+
- | DATA_NODE | SQL |
- +-----------+-------------------------------------------------------------------------------------------------------------+
- | dn1 | insert into travelrecord (id,user_id,traveldate,fee,days) values(100001,'binghe','2017-08-07',510.5,3) |
- +-----------+-------------------------------------------------------------------------------------------------------------+
- 1 row in set (0.00 sec)
說明Mycat將SQL路由到了dn1節(jié)點(diǎn)。
我們執(zhí)行插入語句:
- mysql> insert into travelrecord (id,user_id,traveldate,fee,days) values(100001,'binghe','2020-11-10',510.5,3);
- Query OK, 1 row affected, 1 warning (0.01 sec)
- mysql>
錄入到dn2節(jié)點(diǎn)
我們在命令行輸入如下語句:
- explain insert into travelrecord (id,user_id,traveldate,fee,days) values(8000004,'binghe','2017-08-07',510.5,3);
結(jié)果如下:
- mysql> explain insert into travelrecord (id,user_id,traveldate,fee,days) values(8000004,'binghe','2020-11-10',510.5,3);
- +-----------+--------------------------------------------------------------------------------------------------------------+
- | DATA_NODE | SQL |
- +-----------+--------------------------------------------------------------------------------------------------------------+
- | dn2 | insert into travelrecord (id,user_id,traveldate,fee,days) values(8000004,'binghe','2020-11-10',510.5,3) |
- +-----------+--------------------------------------------------------------------------------------------------------------+
- 1 row in set (0.00 sec)
說明Mycat將SQL路由到了dn2節(jié)點(diǎn),我們執(zhí)行插入語句:
- mysql> insert into travelrecord (id,user_id,traveldate,fee,days) values(8000004,'binghe','2017-08-07',510.5,3);
- Query OK, 1 row affected, 1 warning (0.06 sec)
路由到dn3節(jié)點(diǎn)
我們在命令行輸入如下語句
- explain insert into travelrecord (id,user_id,traveldate,fee,days) values(10000004,'binghe','2017-08-07',510.5,3);
結(jié)果為:
- mysql> explain insert into travelrecord (id,user_id,traveldate,fee,days) values(10000004,'binghe','2020-11-10',510.5,3);
- +-----------+---------------------------------------------------------------------------------------------------------------+
- | DATA_NODE | SQL |
- +-----------+---------------------------------------------------------------------------------------------------------------+
- | dn3 | insert into travelrecord (id,user_id,traveldate,fee,days) values(10000004,'binghe','2020-11-10',510.5,3) |
- +-----------+---------------------------------------------------------------------------------------------------------------+
- 1 row in set (0.00 sec)
說明Mycat將SQL路由到了dn3節(jié)點(diǎn),我們同樣執(zhí)行插入語句的操作
- mysql> insert into travelrecord (id,user_id,traveldate,fee,days) values(10000004,'binghe','2017-08-07',510.5,3);
- Query OK, 1 row affected, 1 warning (0.01 sec)
查詢測試
查詢所有數(shù)據(jù)
在命令行執(zhí)行如下語句:
- explain select * from travelrecord;
結(jié)果為:
- mysql> explain select * from travelrecord;
- +-----------+--------------------------------------+
- | DATA_NODE | SQL |
- +-----------+--------------------------------------+
- | dn1 | SELECT * FROM travelrecord LIMIT 100 |
- | dn2 | SELECT * FROM travelrecord LIMIT 100 |
- | dn3 | SELECT * FROM travelrecord LIMIT 100 |
- +-----------+--------------------------------------+
- 3 rows in set (0.01 sec)
說明查詢所有的數(shù)據(jù),Mycat是將SQL語句路由到了所有的數(shù)據(jù)分片,即dn1,dn2,dn3節(jié)點(diǎn)上。
根據(jù)id查詢指定數(shù)據(jù)
我們分別在命令行中執(zhí)行如下SQL:
- explain select * from travelrecord where id = 1000004;
- explain select * from travelrecord where id = 8000004;
- explain select * from travelrecord where id = 10000004;
得到的結(jié)果依次如下:
- mysql> explain select * from travelrecord where id = 1000004;
- +-----------+---------------------------------------------------------+
- | DATA_NODE | SQL |
- +-----------+---------------------------------------------------------+
- | dn1 | SELECT * FROM travelrecord WHERE id = 1000004 LIMIT 100 |
- +-----------+---------------------------------------------------------+
- 1 row in set (0.06 sec)
- mysql> explain select * from travelrecord where id = 8000004;
- +-----------+---------------------------------------------------------+
- | DATA_NODE | SQL |
- +-----------+---------------------------------------------------------+
- | dn2 | SELECT * FROM travelrecord WHERE id = 8000004 LIMIT 100 |
- +-----------+---------------------------------------------------------+
- 1 row in set (0.00 sec)
- mysql> explain select * from travelrecord where id = 10000004;
- +-----------+----------------------------------------------------------+
- | DATA_NODE | SQL |
- +-----------+----------------------------------------------------------+
- | dn3 | SELECT * FROM travelrecord WHERE id = 10000004 LIMIT 100 |
- +-----------+----------------------------------------------------------+
- 1 row in set (0.00 sec)
說明:按照分片字段查詢,Mycat只會將SQL路由到指定的數(shù)據(jù)分片。
刪表測試
在命令行輸入如下SQL:
- explain drop table travelrecord;
結(jié)果如下
- mysql> explain drop table travelrecord;
- +-----------+-------------------------+
- | DATA_NODE | SQL |
- +-----------+-------------------------+
- | dn1 | drop table travelrecord |
- | dn2 | drop table travelrecord |
- | dn3 | drop table travelrecord |
- +-----------+-------------------------+
- 3 rows in set (0.00 sec)
有結(jié)果可知,刪表操作和創(chuàng)建表操作一樣,Mycat在本實(shí)例中都會將SQL路由到所有的數(shù)據(jù)分片。
注意:本文的Mycat路由結(jié)果針對本文的配置實(shí)例,其他配置下,Mycat的路由結(jié)果可能會有不同。
好了,我們今天就到這兒吧,我是冰河,我們下期見~~
本文轉(zhuǎn)載自微信公眾號「冰河技術(shù)」,可以通過以下二維碼關(guān)注。轉(zhuǎn)載本文請聯(lián)系冰河技術(shù)公眾號。