Incorrect amount of 2M hugepages deployed when dpdk is enabled

Bug #1651676 reported by Thomas Moll
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Invalid
High
Fuel Sustaining

Bug Description

When hugepages and dpdk is enabled, the actual amount of created 2.0MB hugepages does not match with the amount configured in fuel under node attributes.
It seems that the actual value is the sum of the configured value and the memory configured for DPDK Huge Pages.

Example:
Fuel node attributes as follows (see also attached screen shot)
Nova huge pages
Size Count
2.0MB 2048
1.0GB 10
DPDK Huge Pages 1024 DPDK Huge Pages per NUMA node in MB

After deployment we see 3072 2.0MB hugepages and 10 1.0GB hugepages

# cat /sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages
3072
# cat /sys/kernel/mm/hugepages/hugepages-1048576kB/nr_hugepages
10

Which fits the the generated /etc/default/grub file:
GRUB_CMDLINE_LINUX=" console=tty0 net.ifnames=1 biosdevname=0 rootdelay=90 nomodeset hugepagesz=2M hugepages=3072 hugepagesz=1G hugepages=10

The DPDK uses one 1.0GB huge pages:
grep huge /proc/*/numa_maps
/proc/944684/numa_maps:7fc240000000 default file=/mnt/hugepages_1GB/rtemap_5 huge dirty=1 mapmax=2 N1=1
/proc/944684/numa_maps:7fc3c0000000 default file=/mnt/hugepages_1GB/rtemap_0 huge dirty=1 mapmax=2 N0=1

Revision history for this message
Thomas Moll (tourfunz) wrote :
Revision history for this message
Oleksiy Molchanov (omolchanov) wrote :

Please attach diagnostic snapshot, marking as Incomplete.

Changed in fuel:
status: New → Incomplete
Changed in fuel:
assignee: nobody → Fuel Sustaining (fuel-sustaining-team)
milestone: none → 9.2
importance: Undecided → High
Changed in fuel:
milestone: 9.2 → 9.3
Revision history for this message
Mikhail Chernik (mchernik) wrote :

Currently hugepages for OVS+DPDK are allocated from 2M pool, so the total number of 2M hugepages is Nova hugepages and DPDK hugepages.

For a host with 2 NUMA nodes: 2048 (nova hugepages) + (numa nodes) * 1024M/2M DPDK hugepages, which is 3072.

Note the different units for Nova ( # of pages) and DPDK ( size in MB) hugepages.

Changed in fuel:
status: Incomplete → Invalid
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.