(Go: >> BACK << -|- >> HOME <<)
SlideShare a Scribd company logo

MySQL: From Single Instance to Big Data

•
•
Morgan Tocker
Morgan Tocker

The document discusses various MySQL database architectures for different usage needs, from single server setups to high availability configurations. It begins with traditional single server and web/database tier setups. It then covers high availability options using MySQL replication, shared storage, and MySQL Cluster. Popular topologies include master-slave replication for scaling reads, read-write splitting between master and slaves, and using slaves for reporting queries to improve performance. Considerations like network latency, failure handling, and limitations of read-write splitting are also discussed.

1 of 46
Download to read offline
MySQL: From Single Instance to Big Data
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | From  Single  Instance  to   Big  Data Popular  LAMP  Architectures Morgan  Tocker   MySQL  Community  Manager   August,  2014
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Safe  Harbor  Statement The  following  is  intended  to  outline  our  general  product  direction.   It  is  intended  for  information  purposes  only,  and  may  not  be   incorporated  into  any  contract.  It  is  not  a  commitment  to  deliver   any  material,  code,  or  functionality,  and  should  not  be  relied  upon   in  making  purchasing  decisions.  The  development,  release,  and   timing  of  any  features  or  functionality  described  for  Oracle’s   products  remains  at  the  sole  discretion  of  Oracle. Oracle  Confidential  –  Internal/Restricted/Highly  Restricted 3
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted Welcome ..  and  thank  you  for  coming! • Today  talk  is:   • Experience-­‐Level:  Beginner   • We  will  be  discussing  topologies  and  common  MySQL   setups  to  respond  to  various  needs   • There  are  no  stupid  questions   • Please  raise  your  hand  and  interrupt!   4
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted 5 Program  Agenda Common  Architectures   Sharding  and  Functional  Partitioning   Caching   The  Cloud   Hadoop 1 2 3 4 5
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted In  the  beginning… • Single  server  for  all  usage   • MySQL  and  Web  Server   run  side-­‐by-­‐side 6 www  +   mysql
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted Web  and  Database  Tiers • Web  Server  Tier  speaking   to  Database  Server  via   local  network   • Network  latency  not   normally  the  issue   • Retrofits  well 7 www MySQL www www
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted Network  Latency How  important  is  it  to  merge  queries  together? • Simple  queries  to  MySQL:   • 0.1ms   • Typical  network  latency:   • 0.1ms  to  1ms   • It  can  matter  in  some  poorly  designed  applications  that   repeat  similar  queries  within  a  loop  (often  called  N+1). 8 http://www.tocker.ca/2013/11/18/how-­‐important-­‐is-­‐it-­‐to-­‐merge-­‐queries-­‐together.html
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted Web  and  Database  (Alternative) • Common  practice  for   shared  hosting   environments   • Provides  increased  “noisy   neighbour”  protection.   • Less  common  otherwise. 9 www  +   mysql www  +   mysql www  +   mysql
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted High  Availability  Options Built-­‐in  MySQL  Replication   Asynchronous  and  Semi-­‐ Synchronous   Good  support  for  remote   replicas. SAN/Shared  Storage   Requires  use  of  ACID   Storage  Engine.   Use  with  cluster  tools  to   failover. DRBD   Linux  kernel  module  to   provide  network-­‐level  RAID.   Usage  is  similar  to  SAN/ Shared  Storage MySQL  Cluster   Storage  Engine  with  built  in   Replication.   Suitability  situationally   dependent. 10 MySQL MySQLMySQL MySQL MySQLSAN MySQL MySQLDRBD MySQL MySQLNDB
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted How  HA  Failover  Works In  combination  with  a  management  framework • A  Virtual  IP  Address  pointing  to  active  master   • A  proxy  address  (routing  to  active  master)   • A  modified  MySQL  connector 11 ^ typically
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | MySQL Oracle  Confidential  –  Internal/Restricted/Highly  Restricted Most  Common  HA  Starting  Point • Primary  MySQL  Server   • Passive  slaves  using   MySQL  Replication   • Replication  is  logical   • Very  useful  to  support   version  upgrades  (and   some  other  changes) 12 www   (multiple) MySQL
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Circular  ring 13 • Not  a  common  topology   • No  conflict  resolution  or   shared  locking   infrastructure.   • Bad  things  can  happen. MySQL MySQL MySQL MySQL
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Master-­‐master 14 • Works  best  with  writes   being  directed  to  only  one   master.   • Similar  to  master/slave   but  failover  is  pre-­‐ configured. MySQLMySQL
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted Making  Use  of  the  Slave • Reporting  queries  are  an   immediate  candidate  for   slaves   • Ensures  good  QoS  for   primary  MySQL  Server 15 www   (multiple) MySQL MySQLMySQL
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted Read-­‐Write  Split • Application-­‐awareness  to   send  writes  to  master  and   reads  to  slaves   • Historically  very  common   with  MySQL 16 www   (multiple) MySQL MySQLMySQL
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted Read-­‐Write  Split Limitations • Read-­‐after-­‐write  can  return  stale  data   • All  slaves  must  accept  all  writes     • Relies  on  read  volume  being  much  higher  than  write   volume  (true  for  many  applications) 17
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Multi-­‐Source  Fan-­‐In 18 • MySQL  5.7  announced   feature   • Currently  a  slave  can  only   have  one  master MySQL MySQL MySQL MySQL
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | 1 Oracle  Confidential  –  Internal/Restricted/Highly  Restricted 19 Program  Agenda Common  Architectures   Sharding  and  Functional  Partitioning   Caching   The  Cloud   Hadoop 2 3 4 5
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted Write  Scaling • Replication  Provides  Read-­‐Scaling   • By  default  all  nodes  accept  all  writes   • Filtering  by  table  or  database  possible,  but  reduces   failover  ability   20
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted Functional  Partitioning • Find  a  set  of  unrelated  tables  and  move  them  to  their   own  MySQL  Server   • The  application  must  manage  which  MySQL  server  to   connect  to 21
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted Sharding • Split  an  Individual  table  across  multiple  Servers   • Sharding  is  performed  based  on  a  key 22
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Shard  Key • i.e.  user_id,  country,  network_id   • Ideally  the  key  follows  the  access  pattern  of  the  data.   • Bad  examples:   • First  letter  of  username   • Good  Examples:   • Network,  Country  etc. 23
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Shard  Balancing • Harder  than  it  sounds.   • In  many  applications  one  user  can  consume  far  more   resources  than  the  average. 24
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted Cross  shard  queries? • Cross  Shard  queries  usually*  pushed  down  to  the   application  to  perform   • Ideally  the  shard  key  follows  the  access  pattern  of  the   data  so  this  is  not  required. 25 *  Third  party  middleware  does  exist.
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted MySQL  Fabric MySQL  Farm  Management • We  now  how  an  official  tool  to  support  sharding!   • MySQL  Fabric  released  May  2014 26
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted MySQL  Fabric MySQL  Farm  Management 27 http://dev.mysql.com/tech-­‐resources/articles/mysql-­‐fabric-­‐ga.html
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted 28 Program  Agenda Common  Architectures   Sharding  and  Functional  Partitioning   Caching   The  Cloud   Hadoop 2 3 4 5 1 3
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted Caching With  memcached  or  a  similar  technology • Common  to  include  a  look  aside  cache  in  combination   with  MySQL: 29 value = get_from_memcache(key);
 if (value === null) {
 value = get_value_from_database(key);
 set_memcache(key, value)
 }
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted Caching  Benefits • Increases  capacity  by  eliminating  high  expense  items   • Sits  on  top  of  another  application  very  easily 30
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted Caching  Downsides • Need  to  ensure  that  non-­‐cached  performance  is  still   acceptable.   • Cache  invalidation  is  hard  :) 31 http://www.tocker.ca/2013/11/25/query-­‐optimization-­‐versus-­‐caching.html
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted Not-­‐Caching MySQL  Memcached  Interface • MySQL  5.6  now  speaks  the  memcached  protocol!     • An  alternative  high  performance  interface  to  MySQL 32
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted MySQL  Memcached 5.6  Performance  Benchmark 33
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted MySQL  Memcached 5.7  Performance  Benchmark 34 48 Core Machine / Read Only Memcached http://dimitrik.free.fr/blog/archives/2013/11/mysql-performance-over-1m-qps-with-innodb-memcached-plugin-in-mysql-57.html http://mysqlserverteam.com/mysql-5-7-3-deep-dive-into-1mil-qps-with-innodb-memcached/
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted 35 Program  Agenda Common  Architectures   Sharding  and  Functional  Partitioning   Caching   The  Cloud   Hadoop 2 3 4 5 1 4
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted Cloud  +  MySQL Not  much  changes! • Typically  no  VIPs  for  HA  failover   • Typical  for  smaller  hardware  to  be  used  as  building   blocks 36
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Is  it  better  to  scale  vertical  or  horizontal? • Ideally  some  level  of  both.   • Too  small:  can  not  balance  out  sudden  blips.   • Too  big:  no  natural  isolation  from  very  large  bursts. 37 http://www.tocker.ca/2014/04/22/five-­‐reasons-­‐why-­‐vertical-­‐scalability-­‐matters.html
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | More  RAM  is  often  better • Twice  as  much  RAM  !=  Twice  as  Fast   • In  some  scenarios  it  will  be  >10x 38 http://www.tocker.ca/2013/05/10/twice-­‐as-­‐much-­‐ram-­‐does-­‐not-­‐equal-­‐twice-­‐as-­‐fast.html
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted 39 Program  Agenda Common  Architectures   Sharding  and  Functional  Partitioning   Caching   The  Cloud   Hadoop 2 3 4 5 1 5
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted MySQL  Usage By  Query  Type 40 Easy :) Great GoodDataVolume Query Complexity *Hadoop Applier
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted The  Edge  Case MySQL  Hadoop  Applier • Common  to  use  the  tools  together     • Run  queries  in  parallel  with  Hive 41
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted Hive SQL  Queries  for  Hadoop • Think  of  it  like  a  large  freight  train   • Queries  may  take  minutes   • Does  not  specifically  require  indexes 42
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted MySQL+Hive • Incredibly  common  to  see  both  in  use   • Real-­‐time  data  stored  in  MySQL   • Log-­‐like  historical  data  stored  in  Hive   • Reporting  queries  sent  to  Hive 43
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Hive  (cont.) 44 CREATE EXTERNAL TABLE page_view_stg(viewTime INT, userid BIGINT, page_url STRING, referrer_url STRING, ip STRING COMMENT 'IP Address of the User', country STRING COMMENT 'country of origination') COMMENT 'This is the staging page view table' ROW FORMAT DELIMITED FIELDS TERMINATED BY '44' LINES TERMINATED BY '12' STORED AS TEXTFILE LOCATION '/user/data/staging/page_view'; hadoop dfs -put /tmp/pv_2008-06-08.txt /user/data/staging/page_view FROM page_view_stg pvs INSERT OVERWRITE TABLE page_view PARTITION(dt='2008-06-08', country='US') SELECT pvs.viewTime, pvs.userid, pvs.page_url, pvs.referrer_url, null, null, pvs.ip WHERE pvs.country = 'US';
Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted 45
MySQL: From Single Instance to Big Data

More Related Content

What's hot

MySQL Manchester TT - Performance Tuning
MySQL Manchester TT - Performance TuningMySQL Manchester TT - Performance Tuning
MySQL Manchester TT - Performance Tuning
Mark Swarbrick
 
MySQL Performance Metrics that Matter
MySQL Performance Metrics that MatterMySQL Performance Metrics that Matter
MySQL Performance Metrics that Matter
Morgan Tocker
 
Using MySQL in Automated Testing
Using MySQL in Automated TestingUsing MySQL in Automated Testing
Using MySQL in Automated Testing
Morgan Tocker
 
MySQL 5.7 Replication News
MySQL 5.7 Replication News MySQL 5.7 Replication News
MySQL 5.7 Replication News
Ted Wennmark
 
Proxysql use case scenarios fosdem17
Proxysql use case scenarios fosdem17Proxysql use case scenarios fosdem17
Proxysql use case scenarios fosdem17
Alkin Tezuysal
 
My sql 5.6&MySQL Cluster 7.3
My sql 5.6&MySQL Cluster 7.3My sql 5.6&MySQL Cluster 7.3
My sql 5.6&MySQL Cluster 7.3
Oleksii(Alexey) Porytskyi
 
Mysql User Camp : 20th June - Mysql New Features
Mysql User Camp : 20th June - Mysql New FeaturesMysql User Camp : 20th June - Mysql New Features
Mysql User Camp : 20th June - Mysql New Features
Tarique Saleem
 
MySQL 5.6 - Operations and Diagnostics Improvements
MySQL 5.6 - Operations and Diagnostics ImprovementsMySQL 5.6 - Operations and Diagnostics Improvements
MySQL 5.6 - Operations and Diagnostics Improvements
Morgan Tocker
 
MySQL Tech Tour 2015 - 5.7 Whats new
MySQL Tech Tour 2015 - 5.7 Whats newMySQL Tech Tour 2015 - 5.7 Whats new
MySQL Tech Tour 2015 - 5.7 Whats new
Mark Swarbrick
 
Mysql User Camp : 20-June-14 : Mysql Fabric
Mysql User Camp : 20-June-14 : Mysql FabricMysql User Camp : 20-June-14 : Mysql Fabric
Mysql User Camp : 20-June-14 : Mysql Fabric
Mysql User Camp
 
Barcelona mysqlnd qc
Barcelona mysqlnd qcBarcelona mysqlnd qc
Barcelona mysqlnd qc
Anis Berejeb
 
My sql5.7 whatsnew_presentedatgids2015
My sql5.7 whatsnew_presentedatgids2015My sql5.7 whatsnew_presentedatgids2015
My sql5.7 whatsnew_presentedatgids2015
Sanjay Manwani
 
Introduction to MySQL
Introduction to MySQLIntroduction to MySQL
Introduction to MySQL
Ted Wennmark
 
MySQL 5.7: Focus on InnoDB
MySQL 5.7: Focus on InnoDBMySQL 5.7: Focus on InnoDB
MySQL 5.7: Focus on InnoDB
Mario Beck
 
MySQL InnoDB Cluster and NDB Cluster
MySQL InnoDB Cluster and NDB ClusterMySQL InnoDB Cluster and NDB Cluster
MySQL InnoDB Cluster and NDB Cluster
Mario Beck
 
What's new in MySQL 5.7, Oracle Virtual Technology Summit, 2016
What's new in MySQL 5.7, Oracle Virtual Technology Summit, 2016What's new in MySQL 5.7, Oracle Virtual Technology Summit, 2016
What's new in MySQL 5.7, Oracle Virtual Technology Summit, 2016
Geir Høydalsvik
 
Understanding MySql locking issues
Understanding MySql locking issuesUnderstanding MySql locking issues
Understanding MySql locking issues
Om Vikram Thapa
 
MySQL HA
MySQL HAMySQL HA
MySQL HA
Ted Wennmark
 
MySQL 5.6 Updates
MySQL 5.6 UpdatesMySQL 5.6 Updates
MySQL 5.6 Updates
Dave Stokes
 
MySQL 5.7 NEW FEATURES, BETTER PERFORMANCE, AND THINGS THAT WILL BREAK -- Mid...
MySQL 5.7 NEW FEATURES, BETTER PERFORMANCE, AND THINGS THAT WILL BREAK -- Mid...MySQL 5.7 NEW FEATURES, BETTER PERFORMANCE, AND THINGS THAT WILL BREAK -- Mid...
MySQL 5.7 NEW FEATURES, BETTER PERFORMANCE, AND THINGS THAT WILL BREAK -- Mid...
Dave Stokes
 

What's hot (20)

MySQL Manchester TT - Performance Tuning
MySQL Manchester TT - Performance TuningMySQL Manchester TT - Performance Tuning
MySQL Manchester TT - Performance Tuning
 
MySQL Performance Metrics that Matter
MySQL Performance Metrics that MatterMySQL Performance Metrics that Matter
MySQL Performance Metrics that Matter
 
Using MySQL in Automated Testing
Using MySQL in Automated TestingUsing MySQL in Automated Testing
Using MySQL in Automated Testing
 
MySQL 5.7 Replication News
MySQL 5.7 Replication News MySQL 5.7 Replication News
MySQL 5.7 Replication News
 
Proxysql use case scenarios fosdem17
Proxysql use case scenarios fosdem17Proxysql use case scenarios fosdem17
Proxysql use case scenarios fosdem17
 
My sql 5.6&MySQL Cluster 7.3
My sql 5.6&MySQL Cluster 7.3My sql 5.6&MySQL Cluster 7.3
My sql 5.6&MySQL Cluster 7.3
 
Mysql User Camp : 20th June - Mysql New Features
Mysql User Camp : 20th June - Mysql New FeaturesMysql User Camp : 20th June - Mysql New Features
Mysql User Camp : 20th June - Mysql New Features
 
MySQL 5.6 - Operations and Diagnostics Improvements
MySQL 5.6 - Operations and Diagnostics ImprovementsMySQL 5.6 - Operations and Diagnostics Improvements
MySQL 5.6 - Operations and Diagnostics Improvements
 
MySQL Tech Tour 2015 - 5.7 Whats new
MySQL Tech Tour 2015 - 5.7 Whats newMySQL Tech Tour 2015 - 5.7 Whats new
MySQL Tech Tour 2015 - 5.7 Whats new
 
Mysql User Camp : 20-June-14 : Mysql Fabric
Mysql User Camp : 20-June-14 : Mysql FabricMysql User Camp : 20-June-14 : Mysql Fabric
Mysql User Camp : 20-June-14 : Mysql Fabric
 
Barcelona mysqlnd qc
Barcelona mysqlnd qcBarcelona mysqlnd qc
Barcelona mysqlnd qc
 
My sql5.7 whatsnew_presentedatgids2015
My sql5.7 whatsnew_presentedatgids2015My sql5.7 whatsnew_presentedatgids2015
My sql5.7 whatsnew_presentedatgids2015
 
Introduction to MySQL
Introduction to MySQLIntroduction to MySQL
Introduction to MySQL
 
MySQL 5.7: Focus on InnoDB
MySQL 5.7: Focus on InnoDBMySQL 5.7: Focus on InnoDB
MySQL 5.7: Focus on InnoDB
 
MySQL InnoDB Cluster and NDB Cluster
MySQL InnoDB Cluster and NDB ClusterMySQL InnoDB Cluster and NDB Cluster
MySQL InnoDB Cluster and NDB Cluster
 
What's new in MySQL 5.7, Oracle Virtual Technology Summit, 2016
What's new in MySQL 5.7, Oracle Virtual Technology Summit, 2016What's new in MySQL 5.7, Oracle Virtual Technology Summit, 2016
What's new in MySQL 5.7, Oracle Virtual Technology Summit, 2016
 
Understanding MySql locking issues
Understanding MySql locking issuesUnderstanding MySql locking issues
Understanding MySql locking issues
 
MySQL HA
MySQL HAMySQL HA
MySQL HA
 
MySQL 5.6 Updates
MySQL 5.6 UpdatesMySQL 5.6 Updates
MySQL 5.6 Updates
 
MySQL 5.7 NEW FEATURES, BETTER PERFORMANCE, AND THINGS THAT WILL BREAK -- Mid...
MySQL 5.7 NEW FEATURES, BETTER PERFORMANCE, AND THINGS THAT WILL BREAK -- Mid...MySQL 5.7 NEW FEATURES, BETTER PERFORMANCE, AND THINGS THAT WILL BREAK -- Mid...
MySQL 5.7 NEW FEATURES, BETTER PERFORMANCE, AND THINGS THAT WILL BREAK -- Mid...
 

Similar to MySQL: From Single Instance to Big Data

MySQL Fabric - High Availability & Automated Sharding for MySQL
MySQL Fabric - High Availability & Automated Sharding for MySQLMySQL Fabric - High Availability & Automated Sharding for MySQL
MySQL Fabric - High Availability & Automated Sharding for MySQL
Ted Wennmark
 
MySQL for Oracle DBAs
MySQL for Oracle DBAsMySQL for Oracle DBAs
MySQL for Oracle DBAs
Mario Beck
 
Oracle EM12c Release 4 New Features!
Oracle EM12c Release 4 New Features!Oracle EM12c Release 4 New Features!
Oracle EM12c Release 4 New Features!
Kellyn Pot'Vin-Gorman
 
MySQL Cluster as Transactional NoSQL (KVS)
MySQL Cluster as Transactional NoSQL (KVS)MySQL Cluster as Transactional NoSQL (KVS)
MySQL Cluster as Transactional NoSQL (KVS)
Ryusuke Kajiyama
 
Netherlands Tech Tour 02 - MySQL Fabric
Netherlands Tech Tour 02 - MySQL FabricNetherlands Tech Tour 02 - MySQL Fabric
Netherlands Tech Tour 02 - MySQL Fabric
Mark Swarbrick
 
Developer day v2
Developer day v2Developer day v2
Developer day v2
AiougVizagChapter
 
OOW-TBE-12c-CON7307-Sharable
OOW-TBE-12c-CON7307-SharableOOW-TBE-12c-CON7307-Sharable
OOW-TBE-12c-CON7307-Sharable
Obaidur (OB) Rashid
 
Kscope Not Your Father's Enterprise Manager
Kscope Not Your Father's Enterprise ManagerKscope Not Your Father's Enterprise Manager
Kscope Not Your Father's Enterprise Manager
Kellyn Pot'Vin-Gorman
 
MySQL Fabric
MySQL FabricMySQL Fabric
MySQL Fabric
Mark Swarbrick
 
MySQL London Tech Tour March 2015 - Embedded Database of Choice
MySQL London Tech Tour March 2015 - Embedded Database of ChoiceMySQL London Tech Tour March 2015 - Embedded Database of Choice
MySQL London Tech Tour March 2015 - Embedded Database of Choice
Mark Swarbrick
 
Using MySQL Enterprise Monitor for Continuous Performance Improvement
Using MySQL Enterprise Monitor for Continuous Performance ImprovementUsing MySQL Enterprise Monitor for Continuous Performance Improvement
Using MySQL Enterprise Monitor for Continuous Performance Improvement
Mark Matthews
 
Database as a Service, Collaborate 2016
Database as a Service, Collaborate 2016Database as a Service, Collaborate 2016
Database as a Service, Collaborate 2016
Kellyn Pot'Vin-Gorman
 
Oracle Enterprise Manager for MySQL
Oracle Enterprise Manager for MySQLOracle Enterprise Manager for MySQL
Oracle Enterprise Manager for MySQL
Mario Beck
 
My sql fabric webinar v1.1
My sql fabric webinar v1.1My sql fabric webinar v1.1
My sql fabric webinar v1.1
Ricky Setyawan
 
Confoo 202 - MySQL Group Replication and ReplicaSet
Confoo 202 - MySQL Group Replication and ReplicaSetConfoo 202 - MySQL Group Replication and ReplicaSet
Confoo 202 - MySQL Group Replication and ReplicaSet
Dave Stokes
 
Provisioning Oracle Fusion Middleware Environments with Chef and Puppet
Provisioning Oracle Fusion Middleware Environments with Chef and PuppetProvisioning Oracle Fusion Middleware Environments with Chef and Puppet
Provisioning Oracle Fusion Middleware Environments with Chef and Puppet
Edwin Biemond
 
20141011 my sql clusterv01pptx
20141011 my sql clusterv01pptx20141011 my sql clusterv01pptx
20141011 my sql clusterv01pptx
Ivan Ma
 
1 architecture & design
1 architecture & design1 architecture & design
1 architecture & design
Mark Swarbrick
 
MySQL Enterprise Portfolio
MySQL Enterprise PortfolioMySQL Enterprise Portfolio
MySQL Enterprise Portfolio
Abel Flórez
 
Netherlands Tech Tour 05 - Strategic Operationalization of MySQL
Netherlands Tech Tour 05 - Strategic Operationalization of MySQLNetherlands Tech Tour 05 - Strategic Operationalization of MySQL
Netherlands Tech Tour 05 - Strategic Operationalization of MySQL
Mark Swarbrick
 

Similar to MySQL: From Single Instance to Big Data (20)

MySQL Fabric - High Availability & Automated Sharding for MySQL
MySQL Fabric - High Availability & Automated Sharding for MySQLMySQL Fabric - High Availability & Automated Sharding for MySQL
MySQL Fabric - High Availability & Automated Sharding for MySQL
 
MySQL for Oracle DBAs
MySQL for Oracle DBAsMySQL for Oracle DBAs
MySQL for Oracle DBAs
 
Oracle EM12c Release 4 New Features!
Oracle EM12c Release 4 New Features!Oracle EM12c Release 4 New Features!
Oracle EM12c Release 4 New Features!
 
MySQL Cluster as Transactional NoSQL (KVS)
MySQL Cluster as Transactional NoSQL (KVS)MySQL Cluster as Transactional NoSQL (KVS)
MySQL Cluster as Transactional NoSQL (KVS)
 
Netherlands Tech Tour 02 - MySQL Fabric
Netherlands Tech Tour 02 - MySQL FabricNetherlands Tech Tour 02 - MySQL Fabric
Netherlands Tech Tour 02 - MySQL Fabric
 
Developer day v2
Developer day v2Developer day v2
Developer day v2
 
OOW-TBE-12c-CON7307-Sharable
OOW-TBE-12c-CON7307-SharableOOW-TBE-12c-CON7307-Sharable
OOW-TBE-12c-CON7307-Sharable
 
Kscope Not Your Father's Enterprise Manager
Kscope Not Your Father's Enterprise ManagerKscope Not Your Father's Enterprise Manager
Kscope Not Your Father's Enterprise Manager
 
MySQL Fabric
MySQL FabricMySQL Fabric
MySQL Fabric
 
MySQL London Tech Tour March 2015 - Embedded Database of Choice
MySQL London Tech Tour March 2015 - Embedded Database of ChoiceMySQL London Tech Tour March 2015 - Embedded Database of Choice
MySQL London Tech Tour March 2015 - Embedded Database of Choice
 
Using MySQL Enterprise Monitor for Continuous Performance Improvement
Using MySQL Enterprise Monitor for Continuous Performance ImprovementUsing MySQL Enterprise Monitor for Continuous Performance Improvement
Using MySQL Enterprise Monitor for Continuous Performance Improvement
 
Database as a Service, Collaborate 2016
Database as a Service, Collaborate 2016Database as a Service, Collaborate 2016
Database as a Service, Collaborate 2016
 
Oracle Enterprise Manager for MySQL
Oracle Enterprise Manager for MySQLOracle Enterprise Manager for MySQL
Oracle Enterprise Manager for MySQL
 
My sql fabric webinar v1.1
My sql fabric webinar v1.1My sql fabric webinar v1.1
My sql fabric webinar v1.1
 
Confoo 202 - MySQL Group Replication and ReplicaSet
Confoo 202 - MySQL Group Replication and ReplicaSetConfoo 202 - MySQL Group Replication and ReplicaSet
Confoo 202 - MySQL Group Replication and ReplicaSet
 
Provisioning Oracle Fusion Middleware Environments with Chef and Puppet
Provisioning Oracle Fusion Middleware Environments with Chef and PuppetProvisioning Oracle Fusion Middleware Environments with Chef and Puppet
Provisioning Oracle Fusion Middleware Environments with Chef and Puppet
 
20141011 my sql clusterv01pptx
20141011 my sql clusterv01pptx20141011 my sql clusterv01pptx
20141011 my sql clusterv01pptx
 
1 architecture & design
1 architecture & design1 architecture & design
1 architecture & design
 
MySQL Enterprise Portfolio
MySQL Enterprise PortfolioMySQL Enterprise Portfolio
MySQL Enterprise Portfolio
 
Netherlands Tech Tour 05 - Strategic Operationalization of MySQL
Netherlands Tech Tour 05 - Strategic Operationalization of MySQLNetherlands Tech Tour 05 - Strategic Operationalization of MySQL
Netherlands Tech Tour 05 - Strategic Operationalization of MySQL
 

More from Morgan Tocker

Introducing Spirit - Online Schema Change
Introducing Spirit - Online Schema ChangeIntroducing Spirit - Online Schema Change
Introducing Spirit - Online Schema Change
Morgan Tocker
 
MySQL Usability Guidelines
MySQL Usability GuidelinesMySQL Usability Guidelines
MySQL Usability Guidelines
Morgan Tocker
 
My First 90 days with Vitess
My First 90 days with VitessMy First 90 days with Vitess
My First 90 days with Vitess
Morgan Tocker
 
FOSDEM MySQL and Friends Devroom
FOSDEM MySQL and Friends DevroomFOSDEM MySQL and Friends Devroom
FOSDEM MySQL and Friends Devroom
Morgan Tocker
 
Introducing TiDB - Percona Live Frankfurt
Introducing TiDB - Percona Live FrankfurtIntroducing TiDB - Percona Live Frankfurt
Introducing TiDB - Percona Live Frankfurt
Morgan Tocker
 
TiDB Introduction - Boston MySQL Meetup Group
TiDB Introduction - Boston MySQL Meetup GroupTiDB Introduction - Boston MySQL Meetup Group
TiDB Introduction - Boston MySQL Meetup Group
Morgan Tocker
 
TiDB Introduction - San Francisco MySQL Meetup
TiDB Introduction - San Francisco MySQL MeetupTiDB Introduction - San Francisco MySQL Meetup
TiDB Introduction - San Francisco MySQL Meetup
Morgan Tocker
 
TiDB Introduction
TiDB IntroductionTiDB Introduction
TiDB Introduction
Morgan Tocker
 
MySQL 8.0 Optimizer Guide
MySQL 8.0 Optimizer GuideMySQL 8.0 Optimizer Guide
MySQL 8.0 Optimizer Guide
Morgan Tocker
 
MySQL 5.7 + JSON
MySQL 5.7 + JSONMySQL 5.7 + JSON
MySQL 5.7 + JSON
Morgan Tocker
 
MySQL Query Optimization
MySQL Query OptimizationMySQL Query Optimization
MySQL Query Optimization
Morgan Tocker
 
MySQL 5.7: Core Server Changes
MySQL 5.7: Core Server ChangesMySQL 5.7: Core Server Changes
MySQL 5.7: Core Server Changes
Morgan Tocker
 
Locking and Concurrency Control
Locking and Concurrency ControlLocking and Concurrency Control
Locking and Concurrency Control
Morgan Tocker
 
The InnoDB Storage Engine for MySQL
The InnoDB Storage Engine for MySQLThe InnoDB Storage Engine for MySQL
The InnoDB Storage Engine for MySQL
Morgan Tocker
 
Optimizing MySQL
Optimizing MySQLOptimizing MySQL
Optimizing MySQL
Morgan Tocker
 

More from Morgan Tocker (15)

Introducing Spirit - Online Schema Change
Introducing Spirit - Online Schema ChangeIntroducing Spirit - Online Schema Change
Introducing Spirit - Online Schema Change
 
MySQL Usability Guidelines
MySQL Usability GuidelinesMySQL Usability Guidelines
MySQL Usability Guidelines
 
My First 90 days with Vitess
My First 90 days with VitessMy First 90 days with Vitess
My First 90 days with Vitess
 
FOSDEM MySQL and Friends Devroom
FOSDEM MySQL and Friends DevroomFOSDEM MySQL and Friends Devroom
FOSDEM MySQL and Friends Devroom
 
Introducing TiDB - Percona Live Frankfurt
Introducing TiDB - Percona Live FrankfurtIntroducing TiDB - Percona Live Frankfurt
Introducing TiDB - Percona Live Frankfurt
 
TiDB Introduction - Boston MySQL Meetup Group
TiDB Introduction - Boston MySQL Meetup GroupTiDB Introduction - Boston MySQL Meetup Group
TiDB Introduction - Boston MySQL Meetup Group
 
TiDB Introduction - San Francisco MySQL Meetup
TiDB Introduction - San Francisco MySQL MeetupTiDB Introduction - San Francisco MySQL Meetup
TiDB Introduction - San Francisco MySQL Meetup
 
TiDB Introduction
TiDB IntroductionTiDB Introduction
TiDB Introduction
 
MySQL 8.0 Optimizer Guide
MySQL 8.0 Optimizer GuideMySQL 8.0 Optimizer Guide
MySQL 8.0 Optimizer Guide
 
MySQL 5.7 + JSON
MySQL 5.7 + JSONMySQL 5.7 + JSON
MySQL 5.7 + JSON
 
MySQL Query Optimization
MySQL Query OptimizationMySQL Query Optimization
MySQL Query Optimization
 
MySQL 5.7: Core Server Changes
MySQL 5.7: Core Server ChangesMySQL 5.7: Core Server Changes
MySQL 5.7: Core Server Changes
 
Locking and Concurrency Control
Locking and Concurrency ControlLocking and Concurrency Control
Locking and Concurrency Control
 
The InnoDB Storage Engine for MySQL
The InnoDB Storage Engine for MySQLThe InnoDB Storage Engine for MySQL
The InnoDB Storage Engine for MySQL
 
Optimizing MySQL
Optimizing MySQLOptimizing MySQL
Optimizing MySQL
 

Recently uploaded

Splunk_Remote_Work_Insights_Overview.pptx
Splunk_Remote_Work_Insights_Overview.pptxSplunk_Remote_Work_Insights_Overview.pptx
Splunk_Remote_Work_Insights_Overview.pptx
sudsdeep
 
dachnug51 - HCL Domino Roadmap .pdf
dachnug51 - HCL Domino Roadmap .pdfdachnug51 - HCL Domino Roadmap .pdf
dachnug51 - HCL Domino Roadmap .pdf
DNUG e.V.
 
@Call @Girls in Tiruppur 🤷‍♂️ XXXXXXXX 🤷‍♂️ Tanisha Sharma Best High Class ...
@Call @Girls in Tiruppur 🤷‍♂️ XXXXXXXX 🤷‍♂️ Tanisha Sharma Best High Class ... @Call @Girls in Tiruppur 🤷‍♂️ XXXXXXXX 🤷‍♂️ Tanisha Sharma Best High Class ...
@Call @Girls in Tiruppur 🤷‍♂️ XXXXXXXX 🤷‍♂️ Tanisha Sharma Best High Class ...
Mona Rathore
 
How to debug ColdFusion Applications using “ColdFusion Builder extension for ...
How to debug ColdFusion Applications using “ColdFusion Builder extension for ...How to debug ColdFusion Applications using “ColdFusion Builder extension for ...
How to debug ColdFusion Applications using “ColdFusion Builder extension for ...
Ortus Solutions, Corp
 
Revolutionizing Task Scheduling in ColdBox
Revolutionizing Task Scheduling in ColdBoxRevolutionizing Task Scheduling in ColdBox
Revolutionizing Task Scheduling in ColdBox
Ortus Solutions, Corp
 
Non-Functional Testing Guide_ Exploring Its Types, Importance and Tools.pdf
Non-Functional Testing Guide_ Exploring Its Types, Importance and Tools.pdfNon-Functional Testing Guide_ Exploring Its Types, Importance and Tools.pdf
Non-Functional Testing Guide_ Exploring Its Types, Importance and Tools.pdf
kalichargn70th171
 
mobile-app-development-company-in-noida.pdf
mobile-app-development-company-in-noida.pdfmobile-app-development-company-in-noida.pdf
mobile-app-development-company-in-noida.pdf
Mobile App Development Company in Noida - Drona Infotech
 
ANSYS Mechanical APDL Introductory Tutorials.pdf
ANSYS Mechanical APDL Introductory Tutorials.pdfANSYS Mechanical APDL Introductory Tutorials.pdf
ANSYS Mechanical APDL Introductory Tutorials.pdf
sachin chaurasia
 
Design system: The basis for a consistent design
Design system: The basis for a consistent designDesign system: The basis for a consistent design
Design system: The basis for a consistent design
Ortus Solutions, Corp
 
ℂall Girls in Surat 🔥 +91-7023059433 🔥 Best High ℂlass Surat Esℂorts Serviℂe ...
ℂall Girls in Surat 🔥 +91-7023059433 🔥 Best High ℂlass Surat Esℂorts Serviℂe ...ℂall Girls in Surat 🔥 +91-7023059433 🔥 Best High ℂlass Surat Esℂorts Serviℂe ...
ℂall Girls in Surat 🔥 +91-7023059433 🔥 Best High ℂlass Surat Esℂorts Serviℂe ...
nitu gupta#N06
 
How to Break Your App with Playwright Tests
How to Break Your App with Playwright TestsHow to Break Your App with Playwright Tests
How to Break Your App with Playwright Tests
Ortus Solutions, Corp
 
Intro to Amazon Web Services (AWS) and Gen AI
Intro to Amazon Web Services (AWS) and Gen AIIntro to Amazon Web Services (AWS) and Gen AI
Intro to Amazon Web Services (AWS) and Gen AI
Ortus Solutions, Corp
 
@Call @Girls in Solapur 🤷‍♂️ XXXXXXXX 🤷‍♂️ Tanisha Sharma Best High Class S...
@Call @Girls in Solapur 🤷‍♂️ XXXXXXXX 🤷‍♂️ Tanisha Sharma Best High Class S... @Call @Girls in Solapur 🤷‍♂️ XXXXXXXX 🤷‍♂️ Tanisha Sharma Best High Class S...
@Call @Girls in Solapur 🤷‍♂️ XXXXXXXX 🤷‍♂️ Tanisha Sharma Best High Class S...
Mona Rathore
 
Shivam Pandit working on Php Web Developer.
Shivam Pandit working on Php Web Developer.Shivam Pandit working on Php Web Developer.
Shivam Pandit working on Php Web Developer.
shivamt017
 
BoxLang Developer Tooling: VSCode Extension and Debugger
BoxLang Developer Tooling: VSCode Extension and DebuggerBoxLang Developer Tooling: VSCode Extension and Debugger
BoxLang Developer Tooling: VSCode Extension and Debugger
Ortus Solutions, Corp
 
Break data silos with real-time connectivity using Confluent Cloud Connectors
Break data silos with real-time connectivity using Confluent Cloud ConnectorsBreak data silos with real-time connectivity using Confluent Cloud Connectors
Break data silos with real-time connectivity using Confluent Cloud Connectors
confluent
 
@Call @Girls in Saharanpur 🐱‍🐉 XXXXXXXXXX 🐱‍🐉 Tanisha Sharma Best High Clas...
@Call @Girls in Saharanpur 🐱‍🐉 XXXXXXXXXX 🐱‍🐉 Tanisha Sharma Best High Clas... @Call @Girls in Saharanpur 🐱‍🐉 XXXXXXXXXX 🐱‍🐉 Tanisha Sharma Best High Clas...
@Call @Girls in Saharanpur 🐱‍🐉 XXXXXXXXXX 🐱‍🐉 Tanisha Sharma Best High Clas...
AlinaDevecerski
 
Alluxio Webinar | 10x Faster Trino Queries on Your Data Platform
Alluxio Webinar | 10x Faster Trino Queries on Your Data PlatformAlluxio Webinar | 10x Faster Trino Queries on Your Data Platform
Alluxio Webinar | 10x Faster Trino Queries on Your Data Platform
Alluxio, Inc.
 
Kolkata @ℂall @Girls ꧁❤ 000000000 ❤꧂@ℂall @Girls Service Vip Top Model Safe
Kolkata @ℂall @Girls ꧁❤ 000000000 ❤꧂@ℂall @Girls Service Vip Top Model SafeKolkata @ℂall @Girls ꧁❤ 000000000 ❤꧂@ℂall @Girls Service Vip Top Model Safe
Kolkata @ℂall @Girls ꧁❤ 000000000 ❤꧂@ℂall @Girls Service Vip Top Model Safe
Misti Soneji
 
Java SE 17 Study Guide for Certification - Chapter 02
Java SE 17 Study Guide for Certification - Chapter 02Java SE 17 Study Guide for Certification - Chapter 02
Java SE 17 Study Guide for Certification - Chapter 02
williamrobertherman
 

Recently uploaded (20)

Splunk_Remote_Work_Insights_Overview.pptx
Splunk_Remote_Work_Insights_Overview.pptxSplunk_Remote_Work_Insights_Overview.pptx
Splunk_Remote_Work_Insights_Overview.pptx
 
dachnug51 - HCL Domino Roadmap .pdf
dachnug51 - HCL Domino Roadmap .pdfdachnug51 - HCL Domino Roadmap .pdf
dachnug51 - HCL Domino Roadmap .pdf
 
@Call @Girls in Tiruppur 🤷‍♂️ XXXXXXXX 🤷‍♂️ Tanisha Sharma Best High Class ...
@Call @Girls in Tiruppur 🤷‍♂️ XXXXXXXX 🤷‍♂️ Tanisha Sharma Best High Class ... @Call @Girls in Tiruppur 🤷‍♂️ XXXXXXXX 🤷‍♂️ Tanisha Sharma Best High Class ...
@Call @Girls in Tiruppur 🤷‍♂️ XXXXXXXX 🤷‍♂️ Tanisha Sharma Best High Class ...
 
How to debug ColdFusion Applications using “ColdFusion Builder extension for ...
How to debug ColdFusion Applications using “ColdFusion Builder extension for ...How to debug ColdFusion Applications using “ColdFusion Builder extension for ...
How to debug ColdFusion Applications using “ColdFusion Builder extension for ...
 
Revolutionizing Task Scheduling in ColdBox
Revolutionizing Task Scheduling in ColdBoxRevolutionizing Task Scheduling in ColdBox
Revolutionizing Task Scheduling in ColdBox
 
Non-Functional Testing Guide_ Exploring Its Types, Importance and Tools.pdf
Non-Functional Testing Guide_ Exploring Its Types, Importance and Tools.pdfNon-Functional Testing Guide_ Exploring Its Types, Importance and Tools.pdf
Non-Functional Testing Guide_ Exploring Its Types, Importance and Tools.pdf
 
mobile-app-development-company-in-noida.pdf
mobile-app-development-company-in-noida.pdfmobile-app-development-company-in-noida.pdf
mobile-app-development-company-in-noida.pdf
 
ANSYS Mechanical APDL Introductory Tutorials.pdf
ANSYS Mechanical APDL Introductory Tutorials.pdfANSYS Mechanical APDL Introductory Tutorials.pdf
ANSYS Mechanical APDL Introductory Tutorials.pdf
 
Design system: The basis for a consistent design
Design system: The basis for a consistent designDesign system: The basis for a consistent design
Design system: The basis for a consistent design
 
ℂall Girls in Surat 🔥 +91-7023059433 🔥 Best High ℂlass Surat Esℂorts Serviℂe ...
ℂall Girls in Surat 🔥 +91-7023059433 🔥 Best High ℂlass Surat Esℂorts Serviℂe ...ℂall Girls in Surat 🔥 +91-7023059433 🔥 Best High ℂlass Surat Esℂorts Serviℂe ...
ℂall Girls in Surat 🔥 +91-7023059433 🔥 Best High ℂlass Surat Esℂorts Serviℂe ...
 
How to Break Your App with Playwright Tests
How to Break Your App with Playwright TestsHow to Break Your App with Playwright Tests
How to Break Your App with Playwright Tests
 
Intro to Amazon Web Services (AWS) and Gen AI
Intro to Amazon Web Services (AWS) and Gen AIIntro to Amazon Web Services (AWS) and Gen AI
Intro to Amazon Web Services (AWS) and Gen AI
 
@Call @Girls in Solapur 🤷‍♂️ XXXXXXXX 🤷‍♂️ Tanisha Sharma Best High Class S...
@Call @Girls in Solapur 🤷‍♂️ XXXXXXXX 🤷‍♂️ Tanisha Sharma Best High Class S... @Call @Girls in Solapur 🤷‍♂️ XXXXXXXX 🤷‍♂️ Tanisha Sharma Best High Class S...
@Call @Girls in Solapur 🤷‍♂️ XXXXXXXX 🤷‍♂️ Tanisha Sharma Best High Class S...
 
Shivam Pandit working on Php Web Developer.
Shivam Pandit working on Php Web Developer.Shivam Pandit working on Php Web Developer.
Shivam Pandit working on Php Web Developer.
 
BoxLang Developer Tooling: VSCode Extension and Debugger
BoxLang Developer Tooling: VSCode Extension and DebuggerBoxLang Developer Tooling: VSCode Extension and Debugger
BoxLang Developer Tooling: VSCode Extension and Debugger
 
Break data silos with real-time connectivity using Confluent Cloud Connectors
Break data silos with real-time connectivity using Confluent Cloud ConnectorsBreak data silos with real-time connectivity using Confluent Cloud Connectors
Break data silos with real-time connectivity using Confluent Cloud Connectors
 
@Call @Girls in Saharanpur 🐱‍🐉 XXXXXXXXXX 🐱‍🐉 Tanisha Sharma Best High Clas...
@Call @Girls in Saharanpur 🐱‍🐉 XXXXXXXXXX 🐱‍🐉 Tanisha Sharma Best High Clas... @Call @Girls in Saharanpur 🐱‍🐉 XXXXXXXXXX 🐱‍🐉 Tanisha Sharma Best High Clas...
@Call @Girls in Saharanpur 🐱‍🐉 XXXXXXXXXX 🐱‍🐉 Tanisha Sharma Best High Clas...
 
Alluxio Webinar | 10x Faster Trino Queries on Your Data Platform
Alluxio Webinar | 10x Faster Trino Queries on Your Data PlatformAlluxio Webinar | 10x Faster Trino Queries on Your Data Platform
Alluxio Webinar | 10x Faster Trino Queries on Your Data Platform
 
Kolkata @ℂall @Girls ꧁❤ 000000000 ❤꧂@ℂall @Girls Service Vip Top Model Safe
Kolkata @ℂall @Girls ꧁❤ 000000000 ❤꧂@ℂall @Girls Service Vip Top Model SafeKolkata @ℂall @Girls ꧁❤ 000000000 ❤꧂@ℂall @Girls Service Vip Top Model Safe
Kolkata @ℂall @Girls ꧁❤ 000000000 ❤꧂@ℂall @Girls Service Vip Top Model Safe
 
Java SE 17 Study Guide for Certification - Chapter 02
Java SE 17 Study Guide for Certification - Chapter 02Java SE 17 Study Guide for Certification - Chapter 02
Java SE 17 Study Guide for Certification - Chapter 02
 

MySQL: From Single Instance to Big Data

  • 2. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | From  Single  Instance  to   Big  Data Popular  LAMP  Architectures Morgan  Tocker   MySQL  Community  Manager   August,  2014
  • 3. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Safe  Harbor  Statement The  following  is  intended  to  outline  our  general  product  direction.   It  is  intended  for  information  purposes  only,  and  may  not  be   incorporated  into  any  contract.  It  is  not  a  commitment  to  deliver   any  material,  code,  or  functionality,  and  should  not  be  relied  upon   in  making  purchasing  decisions.  The  development,  release,  and   timing  of  any  features  or  functionality  described  for  Oracle’s   products  remains  at  the  sole  discretion  of  Oracle. Oracle  Confidential  –  Internal/Restricted/Highly  Restricted 3
  • 4. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted Welcome ..  and  thank  you  for  coming! • Today  talk  is:   • Experience-­‐Level:  Beginner   • We  will  be  discussing  topologies  and  common  MySQL   setups  to  respond  to  various  needs   • There  are  no  stupid  questions   • Please  raise  your  hand  and  interrupt!   4
  • 5. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted 5 Program  Agenda Common  Architectures   Sharding  and  Functional  Partitioning   Caching   The  Cloud   Hadoop 1 2 3 4 5
  • 6. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted In  the  beginning… • Single  server  for  all  usage   • MySQL  and  Web  Server   run  side-­‐by-­‐side 6 www  +   mysql
  • 7. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted Web  and  Database  Tiers • Web  Server  Tier  speaking   to  Database  Server  via   local  network   • Network  latency  not   normally  the  issue   • Retrofits  well 7 www MySQL www www
  • 8. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted Network  Latency How  important  is  it  to  merge  queries  together? • Simple  queries  to  MySQL:   • 0.1ms   • Typical  network  latency:   • 0.1ms  to  1ms   • It  can  matter  in  some  poorly  designed  applications  that   repeat  similar  queries  within  a  loop  (often  called  N+1). 8 http://www.tocker.ca/2013/11/18/how-­‐important-­‐is-­‐it-­‐to-­‐merge-­‐queries-­‐together.html
  • 9. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted Web  and  Database  (Alternative) • Common  practice  for   shared  hosting   environments   • Provides  increased  “noisy   neighbour”  protection.   • Less  common  otherwise. 9 www  +   mysql www  +   mysql www  +   mysql
  • 10. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted High  Availability  Options Built-­‐in  MySQL  Replication   Asynchronous  and  Semi-­‐ Synchronous   Good  support  for  remote   replicas. SAN/Shared  Storage   Requires  use  of  ACID   Storage  Engine.   Use  with  cluster  tools  to   failover. DRBD   Linux  kernel  module  to   provide  network-­‐level  RAID.   Usage  is  similar  to  SAN/ Shared  Storage MySQL  Cluster   Storage  Engine  with  built  in   Replication.   Suitability  situationally   dependent. 10 MySQL MySQLMySQL MySQL MySQLSAN MySQL MySQLDRBD MySQL MySQLNDB
  • 11. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted How  HA  Failover  Works In  combination  with  a  management  framework • A  Virtual  IP  Address  pointing  to  active  master   • A  proxy  address  (routing  to  active  master)   • A  modified  MySQL  connector 11 ^ typically
  • 12. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | MySQL Oracle  Confidential  –  Internal/Restricted/Highly  Restricted Most  Common  HA  Starting  Point • Primary  MySQL  Server   • Passive  slaves  using   MySQL  Replication   • Replication  is  logical   • Very  useful  to  support   version  upgrades  (and   some  other  changes) 12 www   (multiple) MySQL
  • 13. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Circular  ring 13 • Not  a  common  topology   • No  conflict  resolution  or   shared  locking   infrastructure.   • Bad  things  can  happen. MySQL MySQL MySQL MySQL
  • 14. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Master-­‐master 14 • Works  best  with  writes   being  directed  to  only  one   master.   • Similar  to  master/slave   but  failover  is  pre-­‐ configured. MySQLMySQL
  • 15. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted Making  Use  of  the  Slave • Reporting  queries  are  an   immediate  candidate  for   slaves   • Ensures  good  QoS  for   primary  MySQL  Server 15 www   (multiple) MySQL MySQLMySQL
  • 16. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted Read-­‐Write  Split • Application-­‐awareness  to   send  writes  to  master  and   reads  to  slaves   • Historically  very  common   with  MySQL 16 www   (multiple) MySQL MySQLMySQL
  • 17. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted Read-­‐Write  Split Limitations • Read-­‐after-­‐write  can  return  stale  data   • All  slaves  must  accept  all  writes     • Relies  on  read  volume  being  much  higher  than  write   volume  (true  for  many  applications) 17
  • 18. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Multi-­‐Source  Fan-­‐In 18 • MySQL  5.7  announced   feature   • Currently  a  slave  can  only   have  one  master MySQL MySQL MySQL MySQL
  • 19. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | 1 Oracle  Confidential  –  Internal/Restricted/Highly  Restricted 19 Program  Agenda Common  Architectures   Sharding  and  Functional  Partitioning   Caching   The  Cloud   Hadoop 2 3 4 5
  • 20. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted Write  Scaling • Replication  Provides  Read-­‐Scaling   • By  default  all  nodes  accept  all  writes   • Filtering  by  table  or  database  possible,  but  reduces   failover  ability   20
  • 21. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted Functional  Partitioning • Find  a  set  of  unrelated  tables  and  move  them  to  their   own  MySQL  Server   • The  application  must  manage  which  MySQL  server  to   connect  to 21
  • 22. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted Sharding • Split  an  Individual  table  across  multiple  Servers   • Sharding  is  performed  based  on  a  key 22
  • 23. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Shard  Key • i.e.  user_id,  country,  network_id   • Ideally  the  key  follows  the  access  pattern  of  the  data.   • Bad  examples:   • First  letter  of  username   • Good  Examples:   • Network,  Country  etc. 23
  • 24. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Shard  Balancing • Harder  than  it  sounds.   • In  many  applications  one  user  can  consume  far  more   resources  than  the  average. 24
  • 25. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted Cross  shard  queries? • Cross  Shard  queries  usually*  pushed  down  to  the   application  to  perform   • Ideally  the  shard  key  follows  the  access  pattern  of  the   data  so  this  is  not  required. 25 *  Third  party  middleware  does  exist.
  • 26. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted MySQL  Fabric MySQL  Farm  Management • We  now  how  an  official  tool  to  support  sharding!   • MySQL  Fabric  released  May  2014 26
  • 27. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted MySQL  Fabric MySQL  Farm  Management 27 http://dev.mysql.com/tech-­‐resources/articles/mysql-­‐fabric-­‐ga.html
  • 28. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted 28 Program  Agenda Common  Architectures   Sharding  and  Functional  Partitioning   Caching   The  Cloud   Hadoop 2 3 4 5 1 3
  • 29. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted Caching With  memcached  or  a  similar  technology • Common  to  include  a  look  aside  cache  in  combination   with  MySQL: 29 value = get_from_memcache(key);
 if (value === null) {
 value = get_value_from_database(key);
 set_memcache(key, value)
 }
  • 30. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted Caching  Benefits • Increases  capacity  by  eliminating  high  expense  items   • Sits  on  top  of  another  application  very  easily 30
  • 31. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted Caching  Downsides • Need  to  ensure  that  non-­‐cached  performance  is  still   acceptable.   • Cache  invalidation  is  hard  :) 31 http://www.tocker.ca/2013/11/25/query-­‐optimization-­‐versus-­‐caching.html
  • 32. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted Not-­‐Caching MySQL  Memcached  Interface • MySQL  5.6  now  speaks  the  memcached  protocol!     • An  alternative  high  performance  interface  to  MySQL 32
  • 33. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted MySQL  Memcached 5.6  Performance  Benchmark 33
  • 34. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted MySQL  Memcached 5.7  Performance  Benchmark 34 48 Core Machine / Read Only Memcached http://dimitrik.free.fr/blog/archives/2013/11/mysql-performance-over-1m-qps-with-innodb-memcached-plugin-in-mysql-57.html http://mysqlserverteam.com/mysql-5-7-3-deep-dive-into-1mil-qps-with-innodb-memcached/
  • 35. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted 35 Program  Agenda Common  Architectures   Sharding  and  Functional  Partitioning   Caching   The  Cloud   Hadoop 2 3 4 5 1 4
  • 36. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted Cloud  +  MySQL Not  much  changes! • Typically  no  VIPs  for  HA  failover   • Typical  for  smaller  hardware  to  be  used  as  building   blocks 36
  • 37. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Is  it  better  to  scale  vertical  or  horizontal? • Ideally  some  level  of  both.   • Too  small:  can  not  balance  out  sudden  blips.   • Too  big:  no  natural  isolation  from  very  large  bursts. 37 http://www.tocker.ca/2014/04/22/five-­‐reasons-­‐why-­‐vertical-­‐scalability-­‐matters.html
  • 38. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | More  RAM  is  often  better • Twice  as  much  RAM  !=  Twice  as  Fast   • In  some  scenarios  it  will  be  >10x 38 http://www.tocker.ca/2013/05/10/twice-­‐as-­‐much-­‐ram-­‐does-­‐not-­‐equal-­‐twice-­‐as-­‐fast.html
  • 39. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted 39 Program  Agenda Common  Architectures   Sharding  and  Functional  Partitioning   Caching   The  Cloud   Hadoop 2 3 4 5 1 5
  • 40. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted MySQL  Usage By  Query  Type 40 Easy :) Great GoodDataVolume Query Complexity *Hadoop Applier
  • 41. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted The  Edge  Case MySQL  Hadoop  Applier • Common  to  use  the  tools  together     • Run  queries  in  parallel  with  Hive 41
  • 42. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted Hive SQL  Queries  for  Hadoop • Think  of  it  like  a  large  freight  train   • Queries  may  take  minutes   • Does  not  specifically  require  indexes 42
  • 43. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted MySQL+Hive • Incredibly  common  to  see  both  in  use   • Real-­‐time  data  stored  in  MySQL   • Log-­‐like  historical  data  stored  in  Hive   • Reporting  queries  sent  to  Hive 43
  • 44. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Hive  (cont.) 44 CREATE EXTERNAL TABLE page_view_stg(viewTime INT, userid BIGINT, page_url STRING, referrer_url STRING, ip STRING COMMENT 'IP Address of the User', country STRING COMMENT 'country of origination') COMMENT 'This is the staging page view table' ROW FORMAT DELIMITED FIELDS TERMINATED BY '44' LINES TERMINATED BY '12' STORED AS TEXTFILE LOCATION '/user/data/staging/page_view'; hadoop dfs -put /tmp/pv_2008-06-08.txt /user/data/staging/page_view FROM page_view_stg pvs INSERT OVERWRITE TABLE page_view PARTITION(dt='2008-06-08', country='US') SELECT pvs.viewTime, pvs.userid, pvs.page_url, pvs.referrer_url, null, null, pvs.ip WHERE pvs.country = 'US';
  • 45. Copyright  ©  2014  Oracle  and/or  its  affiliates.  All  rights  reserved.    | Oracle  Confidential  –  Internal/Restricted/Highly  Restricted 45