ceph查询rbd的使用容量（快速）

ceph在Infernalis加入了一个功能是查询rbd的块设备的使用的大小，默认是可以查询的，但是无法快速查询，那么我们来看看这个功能是怎么开启的

ceph版本

1
2
root@lab8107:~/ceph# ceph -v
ceph version 9.2.0 (bb2ecea240f3a1d525bcb35670cb07bd1f0ca299)

创建RBD设备

我们先来创建一个rbd

1
2
3
4
5
6
7
8
9
root@lab8107:~/ceph# rbd create test --size 4000
root@lab8107:~/ceph# rbd info test
rbd image 'test':
	size 4000 MB in 1000 objects
	order 22 (4096 kB objects)
	block_name_prefix: rbd_data.10305695d26a
	format: 2
	features: layering
	flags:

进行RBD容量使用查询

我们来试一下rbd du命令

1
2
3
4
root@lab8107:~/ceph# rbd du test
warning: fast-diff map is not enabled for test. operation may be slow.
NAME PROVISIONED USED 
test       4000M    0

可以看到有个提示需要开启fast-diff的属性

1
2
3
4
5
6
7
root@lab8107:~/ceph# rbd --help
···
Supported image features:
  layering (+), striping (+), exclusive-lock (*), object-map (*), fast-diff (*), deep-flatten

  (*) supports enabling/disabling on existing images
  (+) enabled by default for new images if features are not specified

可以看到默认开启了 layering striping 属性，后面属性没有开启
我们看一下rbd的man page

1
2
3
4
5
6
7
8
9
10
11
root@lab8107:~/ceph# man rbd
···
--image-feature feature-name
    Specifies which RBD format 2 feature should be enabled when creating an image. Multiple features can be enabled by repeating  this  option  multiple times. The following features are supported:

    · layering: layering support
    · striping: striping v2 support
    · exclusive-lock: exclusive locking support
    · object-map: object map support (requires exclusive-lock)
    · fast-diff: fast diff calculations (requires object-map)
    · deep-flatten: snapshot flatten support

开启RBD属性

可以看到开启fast-diff 需要开启exclusive-lock和 object-map 属性
那么依次开启就好了

1
2
3
4
5
root@lab8107:~/ceph# rbd  feature enable test  exclusive-lock
root@lab8107:~/ceph# rbd  feature enable test  object-map
root@lab8107:~/ceph# rbd  feature enable test  fast-diff
2016-03-24 21:17:23.822720 7f241a5447c0 -1 librbd::ObjectMap: error refreshing object map: (2) No such file or directory
2016-03-24 21:17:23.823191 7f241a5447c0 -1 librbd::ObjectMap: error refreshing object map: (2) No such file or directory

来查看下 rbd info

1
2
3
4
5
6
7
8
9
10
11
root@lab8107:~/ceph# rbd info test
2016-03-24 21:18:37.972235 7f9918a7d7c0 -1 librbd::ObjectMap: error refreshing object map: (2) No such file or directory
rbd image 'test':
	size 4000 MB in 2016-03-24 21:18:37.972900 7f9918a7d7c0 -1 1000librbd::ObjectMap: error refreshing object map: (2) No such file or directory objects

	order 22 (4096 kB objects)
	block_name_prefix: rbd_data.10305695d26a
	format: 2
	features: layering, exclusive-lock, object-map, fast-diff
	flags: object map invalid, fast diff invalid

我们可以看到又报错了，这个是因为是后开启object map，需要重建一下

1
2
3
4
5
root@lab8107:~/ceph# rbd  object-map rebuild  test  
2016-03-24 21:20:05.488515 7fa0141917c0 -1 librbd::ObjectMap: error refreshing object map: (2) No such file or directory
2016-03-24 21:20:05.489142 7fa0141917c0 -1 librbd::ObjectMap: error refreshing object map: (2) No such file or directory
2016-03-24 21:20:05.530344 7fa0141917c0 -1 librbd::ObjectMap: error refreshing object map: (2) No such file or directory
Object Map Rebuild: 100% complete...done.

再次查看下

1
2
3
4
5
6
7
8
root@lab8107:~/ceph# rbd info test
rbd image 'test':
	size 4000 MB in 1000 objects
	order 22 (4096 kB objects)
	block_name_prefix: rbd_data.10305695d26a
	format: 2
	features: layering, exclusive-lock, object-map, fast-diff
	flags:

已经可以了，我们来试下这个功能

1
2
3
root@lab8107:~/ceph# rbd du test
NAME PROVISIONED USED 
test       4000M    0

好了，这个功能已经开启了，这个是对已经创建好的rbd，然后开启这个属性，那么如果不想这么麻烦，默认就开启，创建的时候就开启，有什么方法么，当然是有的

默认开启RBD容量快速查询的方法

1
2
root@lab8107:~/ceph# ceph --show-config|grep rbd_default_features
rbd_default_features = 3

查看下默认配置，这个是3，那么3是什么意思，3=1+2，这个是属性中常用的一种做法，给属性设置一个bit码，在配置的时候，只需要设置加起来的和
在RBD的属性里面：
属性.png-14.1kB

我们要开启 前五个属性那么就是 31
在ceph.conf中添加配置

rbd_default_features = 31

创建后不做任何操作直接查询

1
2
3
4
5
6
7
8
9
10
11
12
root@lab8107:~/ceph# rbd create test1 --size 1000
root@lab8107:~/ceph# rbd info test1
rbd image 'test1':
	size 1000 MB in 250 objects
	order 22 (4096 kB objects)
	block_name_prefix: rbd_data.103c29f2280d
	format: 2
	features: layering, exclusive-lock, object-map, fast-diff
	flags: 
root@lab8107:~/ceph# rbd du test1
NAME  PROVISIONED USED 
test1       1000M    0

可以看到默认就把几个属性都开启好了，关于这个属性的开启就记录到这里，之前已经测试了一次