°Ô½Ã¹° 1,369°Ç
   
RBD QOS
±Û¾´ÀÌ : ÃÖ°í°ü¸®ÀÚ ³¯Â¥ : 2019-08-09 (±Ý) 14:10 Á¶È¸ : 632
±ÛÁÖ¼Ò :
                                
Ciner Backend ´Â ½ºÅ丮Áö Á¦°øÀÚ°¡ ¼³Á¤ÇÑ qos ¸¦ ³ªÅ¸³½´Ù.
¹é¿£µå QoS¿¡´Â ½ºÅ丮Áö Á¦°øÀÚÀÇ Áö¿øÀÌ ÇÊ¿äÇÕ´Ï´Ù. ÀϹÝÀûÀÎ ½ºÅ丮Áö ÀåÄ¡´Â EMC¿Í °°Àº QoS¸¦ Áö¿øÇÏÁö¸¸ ÃֽŠ¹öÀüÀÇ Ceph Mimic RBDµµ IOPS QoS¸¦ Áö¿øÇÏÁö¸¸ ±× ±â´ÉÀº ¿©ÀüÈ÷ ¿Ïº®ÇÏÁö´Â ¾Ê½À´Ï´Ù. µû¶ó¼­ Ceph ½ºÅ丮Áö ¼Ö·ç¼Ç¿¡ ¿¬°áÇÏ´Â »ç¿ëÀÚ´Â ÇÁ·±Æ® ¿£µå Qos¸¦ »ç¿ëÇÏ¿© °¡»ó ½Ã½ºÅÛÀÇ QoS¸¦ µ¥ÀÌÅÍ µð½ºÅ©·Î Á¦ÇÑÇÕ´Ï´Ù.


¡Ø Ceph ¿¡¼­´Â Mimic ¿¡¼­ºÎÅÍ...QOS¸¦ Áö¿øÇÏ¸ç ¾î´ÀÁ¤µµÀÇ Å×½ºÆ®´Â ÇÊ¿ä 
image-meta list (image-meta ls)     Image metadata list keys with values.

image-meta remove (image-meta rm)   Image metadata remove the key and value associated.
image-meta set                      Image metadata set key with value.


image-meta ¼³Á¤
# rbd image-meta list queens_volumes/volume-7b4797af-527b-4ddb-9352-b003dd5662e1
There are 0 metadata on this image.

# rbd image-meta set queens_volumes/volume-7b4797af-527b-4ddb-9352-b003dd5662e1 conf_rbd_qos_iops_limit 1000

# rbd image-meta list queens_volumes/volume-7b4797af-527b-4ddb-9352-b003dd5662e1                           
There is 1 metadatum on this image:
Key                     Value 
conf_rbd_qos_iops_limit 1000  


image-meta »èÁ¦
# rbd image-meta remove queens_volumes/volume-7b4797af-527b-4ddb-9352-b003dd5662e1 conf_rbd_qos_iops_limit

# rbd image-meta list queens_volumes/volume-7b4797af-527b-4ddb-9352-b003dd5662e1
There are 0 metadata on this image.


Pool º°·Î ¼³Á¤ 
# rbd config pool list test_volumes_cephfs |grep qos
rbd_qos_bps_burst                                   0         config 
rbd_qos_bps_limit                                   0         config 
rbd_qos_iops_burst                                  0         config 
rbd_qos_iops_limit                                  0        pool   
rbd_qos_read_bps_burst                              0         config 
rbd_qos_read_bps_limit                              0         config 
rbd_qos_read_iops_burst                             0         config 
rbd_qos_read_iops_limit                             10        config 
rbd_qos_schedule_tick_min                           50        config 
rbd_qos_write_bps_burst                             0         config 
rbd_qos_write_bps_limit                             0         config 
rbd_qos_write_iops_burst                            0         config 
rbd_qos_write_iops_limit                            0         config 


# rbd config pool set test_volumes_cephfs rbd_qos_iops_limit 50

# rbd config pool list test_volumes_cephfs |grep qos
rbd_qos_bps_burst                                   0         config 
rbd_qos_bps_limit                                   0         config 
rbd_qos_iops_burst                                  0         config 
rbd_qos_iops_limit                                  50        pool   
rbd_qos_read_bps_burst                              0         config 
rbd_qos_read_bps_limit                              0         config 
rbd_qos_read_iops_burst                             0         config 
rbd_qos_read_iops_limit                             10        config 
rbd_qos_schedule_tick_min                           50        config 
rbd_qos_write_bps_burst                             0         config 
rbd_qos_write_bps_limit                             0         config 
rbd_qos_write_iops_burst                            0         config 
rbd_qos_write_iops_limit                            0         config 

==>> rbd bench Åø·Î üũÇßÀ»¶§ Àû¿ë OK

:: Dashboard ¿¡¼­ È®ÀÎ


¡Ø mimic ¿¡¼­´Â conf_rbd_qos_iops_limit ¿É¼Ç¸¸ Áö¿øÇϸç....ÀÌÈÄ ¹öÀü(Nautilus)¿¡¼­´Â ¾Æ·¡ ¿É¼Ç±îÁö Áö¿ø°¡´É 

v 14.2.0 Nautilus released  2019. 03.19.
https://ceph.io/releases/v14-2-0-nautilus-released/






Benchmark
# rbd bench --io-type read --io-size 4096 --io-threads 1  <Pool>/<images>
# rbd bench --io-type write --io-size 4096 --io-threads 1  <Pool>/<images>



±âº»°ª
mon ¼­¹ö¿¡¼­¸¸.... ceph.conf ÆÄÀÏ¿¡ »ðÀÔÇϸé Àû¿ë
 :: rbd qos iops limit = 100
service ceph-mon@ceph-mon restart

# ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok  config show |grep qos
    "rbd_qos_bps_burst": "0",
    "rbd_qos_bps_limit": "0",
    "rbd_qos_iops_burst": "0",
    "rbd_qos_iops_limit": "0",
    "rbd_qos_read_bps_burst": "0",
    "rbd_qos_read_bps_limit": "0",
    "rbd_qos_read_iops_burst": "0",
    "rbd_qos_read_iops_limit": "0",
    "rbd_qos_schedule_tick_min": "50",
    "rbd_qos_write_bps_burst": "0",
    "rbd_qos_write_bps_limit": "0",
    "rbd_qos_write_iops_burst": "0",
    "rbd_qos_write_iops_limit": "0",


ceph.conf ÆÄÀÏ¿¡ »ðÀÔÇϸé...
 :: rbd qos iops limit = 100

# ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok  config show |grep qos
    "rbd_qos_bps_burst": "0",
    "rbd_qos_bps_limit": "0",
    "rbd_qos_iops_burst": "0",
    "rbd_qos_iops_limit": "100",
    "rbd_qos_read_bps_burst": "0",
    "rbd_qos_read_bps_limit": "0",
    "rbd_qos_read_iops_burst": "0",
    "rbd_qos_read_iops_limit": "0",
    "rbd_qos_schedule_tick_min": "50",
    "rbd_qos_write_bps_burst": "0",
    "rbd_qos_write_bps_limit": "0",
    "rbd_qos_write_iops_burst": "0",
    "rbd_qos_write_iops_limit": "0",



QOS SETTINGS

librbd supports limiting per image IO, controlled by the following settings.

rbd qos iops limit

Description:The desired limit of IO operations per second.
Type:Unsigned Integer
Required:No
Default:0

rbd qos bps limit

Description:The desired limit of IO bytes per second.
Type:Unsigned Integer
Required:No
Default:0

rbd qos read iops limit

Description:The desired limit of read operations per second.
Type:Unsigned Integer
Required:No
Default:0

rbd qos write iops limit

Description:The desired limit of write operations per second.
Type:Unsigned Integer
Required:No
Default:0

rbd qos read bps limit

Description:The desired limit of read bytes per second.
Type:Unsigned Integer
Required:No
Default:0

rbd qos write bps limit

Description:The desired limit of write bytes per second.
Type:Unsigned Integer
Required:No
Default:0

rbd qos iops burst

Description:The desired burst limit of IO operations.
Type:Unsigned Integer
Required:No
Default:0

rbd qos bps burst

Description:The desired burst limit of IO bytes.
Type:Unsigned Integer
Required:No
Default:0

rbd qos read iops burst

Description:The desired burst limit of read operations.
Type:Unsigned Integer
Required:No
Default:0

rbd qos write iops burst

Description:The desired burst limit of write operations.
Type:Unsigned Integer
Required:No
Default:0

rbd qos read bps burst

Description:The desired burst limit of read bytes.
Type:Unsigned Integer
Required:No
Default:0

rbd qos write bps burst

Description:The desired burst limit of write bytes.
Type:Unsigned Integer
Required:No
Default:0

rbd qos schedule tick min

Description:The minimum schedule tick (in milliseconds) for QoS.
Type:Unsigned Integer
Required:No
Default:50

À̸§ Æнº¿öµå
ºñ¹Ð±Û (üũÇÏ¸é ±Û¾´À̸¸ ³»¿ëÀ» È®ÀÎÇÒ ¼ö ÀÖ½À´Ï´Ù.)
¿ÞÂÊÀÇ ±ÛÀÚ¸¦ ÀÔ·ÂÇϼ¼¿ä.
   

 



 
»çÀÌÆ®¸í : ¸ðÁö¸®³× | ´ëÇ¥ : ÀÌ°æÇö | °³ÀÎÄ¿¹Â´ÏƼ : ·©Å°´åÄÄ ¿î¿µÃ¼Á¦(OS) | °æ±âµµ ¼º³²½Ã ºÐ´ç±¸ | ÀüÀÚ¿ìÆí : mojily°ñ¹ðÀÌchonnom.com Copyright ¨Ï www.chonnom.com www.kyunghyun.net www.mojily.net. All rights reserved.