NUMA tutorial

TAGS: NUMA linux

Intro

Several commands for NUMA administration

Instructions

Verify that your processor is supporting NUMA
dmesg | grep -i numa

Install numactl
apt -y install numactl

List cpu features
lscpu | grep -i numa

Find out pid of process to pin
ps aux | grep ceph-osd

Get current cores assertion of process
ps -mo psr -p $pid

List NUMA topology
numactl --hardware (Bear in mind that hyperthreading can make things much worse)

PIN process to cores via daemon
vim /usr/lib/systemd/system/ceph-osd
/usr/lib/systemd/system/ceph-radosgw\@.service
or via NUMACTL
numactl --cpunodebind=1 --membind=1 ceph-osd

Check
taskset -pc $(pgrep ceph-osd) ; done

Written on February 28, 2019

Archive

linux openstack kubernetes gluster ceph ansible docker systemctl python openshift log centos sed registry kolla kibana keepalived elasticsearch deploy cloud-init auth HA zabbix vsphere vmware venv tools swift ssl ssh scm ruby rsyslog rhel rbac rabbitmq prometheus postgres policy pgpool2 patrole pacemaker ntp nfs net mq monitoring mongo mbr lvm logstash kubespray kubeadm kolla-ansible jenkins jekyII java ironic helm heketi harbor grub github ganesha fluentd fluent-bit fio drbd diskimage-builder devstack debug deb db cisco cicd ceph-ansible calico build bitbucket benchmarking apparmor api NUMA Linux Golang Go ELK 3par