Java 24 вылетает, когда VirtualThread-U призвал OOM-Killer ⇐ JAVA

[Anonymous]

Мы установили Java24 с нашим приложением на сервере Linux EL9. Это сервер 64 ГБ, а куча составляет 48 ГБ. Не проходит трафик, проходящего через приложение, в настоящее время оно бездействует, и через несколько часов (все еще холостое время) сбои с OOM. Единственная трасса, которую мы нашли, появляется в системе журнала сообщений. Трассировка ниже: < /p>
May 20 19:12:47 ventus kernel: VirtualThread-u invoked oom-killer: gfp_mask=0x140cca(GFP_HIGHUSER_MOVABLE|__GFP_COMP), order=0, oom_score_adj=0
May 20 19:12:47 ventus kernel: CPU: 0 PID: 123617 Comm: VirtualThread-u Kdump: loaded Not tainted 5.14.0-583.el9.x86_64 #1
May 20 19:12:47 ventus kernel: Hardware name: VMware, Inc. VMware7,1/440BX Desktop Reference Platform, BIOS VMW71.00V.18227214.B64.2106252220 06/25/2021
May 20 19:12:47 ventus kernel: Call Trace:
May 20 19:12:47 ventus kernel:
May 20 19:12:47 ventus kernel: dump_stack_lvl+0x34/0x48
May 20 19:12:47 ventus kernel: dump_header+0x49/0x212
May 20 19:12:47 ventus kernel: oom_kill_process.cold+0xb/0x10
May 20 19:12:47 ventus kernel: out_of_memory+0xee/0x2b0
May 20 19:12:47 ventus kernel: __alloc_pages_slowpath.constprop.0+0x78f/0xb10
May 20 19:12:47 ventus kernel: __alloc_pages+0x21c/0x250
May 20 19:12:47 ventus kernel: alloc_pages_mpol+0x93/0x1e0
May 20 19:12:47 ventus kernel: ? filemap_get_entry+0xe3/0x140
May 20 19:12:47 ventus kernel: folio_alloc+0x12/0x30
May 20 19:12:47 ventus kernel: __filemap_get_folio+0x189/0x2e0
May 20 19:12:47 ventus kernel: filemap_fault+0x4d5/0x8b0
May 20 19:12:47 ventus kernel: __do_fault+0x34/0x150
May 20 19:12:47 ventus kernel: do_read_fault+0x11e/0x1d0
May 20 19:12:47 ventus kernel: do_pte_missing+0x157/0x200
May 20 19:12:47 ventus kernel: __handle_mm_fault+0x2fe/0x650
May 20 19:12:47 ventus kernel: handle_mm_fault+0xe7/0x250
May 20 19:12:47 ventus kernel: do_user_addr_fault+0x215/0x620
May 20 19:12:47 ventus kernel: exc_page_fault+0x61/0x150
May 20 19:12:47 ventus kernel: asm_exc_page_fault+0x22/0x30
May 20 19:12:47 ventus kernel: RIP: 0033:0x7f94b60872aa
May 20 19:12:47 ventus kernel: Code: 24 08 e8 c9 f8 ff ff 4c 8b 54 24 18 45 31 c0 44 89 e2 89 c5 8b 74 24 08 48 8b 7c 24 10 41 b9 ff ff ff ff b8 ca 00 00 00 0f 05 ef 48 89 44 24 08 e8 1a f9 ff ff 48 8b 44 24 08 e9 69 ff ff ff
May 20 19:12:47 ventus kernel: RSP: 002b:00007f9484efe450 EFLAGS: 00010246
May 20 19:12:47 ventus kernel: RAX: ffffffffffffff92 RBX: 0000000000000000 RCX: 00007f94b60872aa
May 20 19:12:47 ventus kernel: RDX: 0000000000188281 RSI: 0000000000000089 RDI: 00007f8f2c07931c
May 20 19:12:47 ventus kernel: RBP: 0000000000000000 R08: 0000000000000000 R09: 00000000ffffffff
May 20 19:12:47 ventus kernel: R10: 00007f9484efe560 R11: 0000000000000246 R12: 0000000000188281
May 20 19:12:47 ventus kernel: R13: 00007f9484efe4c0 R14: 00007f8f2c07931c R15: 0000000000000000
May 20 19:12:47 ventus kernel:
May 20 19:12:47 ventus kernel: Mem-Info:
May 20 19:12:47 ventus kernel: active_anon:12769877 inactive_anon:63866 isolated_anon:0#012 active_file:0 inactive_file:201 isolated_file:0#012 unevictable:0 dirty:12 writeback:0#012 slab_reclaimable:36397 slab_unreclaimable:17034#012 mapped:1229085 shmem:12618959 pagetables:3733#012 sec_pagetables:0 bounce:0#012 kernel_misc_reclaimable:0#012 free:326200 free_pcp:43 free_cma:0
May 20 19:12:47 ventus kernel: Node 0 active_anon:51079508kB inactive_anon:255464kB active_file:0kB inactive_file:1228kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:4916340kB dirty:48kB writeback:0kB shmem:50475836kB shmem_thp:0kB shmem_pmdmapped:0kB anon_thp:0kB writeback_tmp:0kB kernel_stack:7296kB pagetables:14932kB sec_pagetables:0kB all_unreclaimable? no
May 20 19:12:47 ventus kernel: Node 0 DMA free:11264kB boost:0kB min:244kB low:304kB high:364kB reserved_highatomic:0KB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15996kB managed:15360kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
May 20 19:12:47 ventus kernel: lowmem_reserve[]: 0 2442 63729 63729 63729
May 20 19:12:47 ventus kernel: Node 0 DMA32 free:285892kB boost:0kB min:40756kB low:50944kB high:61132kB reserved_highatomic:0KB active_anon:8kB inactive_anon:0kB active_file:116kB inactive_file:356kB unevictable:0kB writepending:0kB present:3128732kB managed:2538836kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
May 20 19:12:47 ventus kernel: lowmem_reserve[]: 0 0 61286 61286 61286
May 20 19:12:47 ventus kernel: Node 0 Normal free:1007540kB boost:0kB min:1007572kB low:1259464kB high:1511356kB reserved_highatomic:0KB active_anon:51129440kB inactive_anon:205528kB active_file:0kB inactive_file:968kB unevictable:0kB writepending:48kB present:63963136kB managed:62764236kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
May 20 19:12:47 ventus kernel: lowmem_reserve[]: 0 0 0 0 0
May 20 19:12:47 ventus kernel: Node 0 DMA: 0*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 2*4096kB (M) = 11264kB
May 20 19:12:47 ventus kernel: Node 0 DMA32: 3*4kB (UM) 3*8kB (UM) 4*16kB (UM) 4*32kB (UM) 4*64kB (UM) 2*128kB (M) 1*256kB (U) 1*512kB (U) 1*1024kB (U) 0*2048kB 69*4096kB (UM) = 285156kB
May 20 19:12:47 ventus kernel: Node 0 Normal: 29247*4kB (UME) 29462*8kB (UME) 11423*16kB (UME) 3867*32kB (UME) 1522*64kB (UME) 444*128kB (UME) 166*256kB (UM) 88*512kB (UME) 50*1024kB (M) 13*2048kB (M) 7*4096kB (UM) = 1007484kB
May 20 19:12:47 ventus kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
May 20 19:12:47 ventus kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
May 20 19:12:47 ventus kernel: 12619057 total pagecache pages
May 20 19:12:47 ventus kernel: 0 pages in swap cache
May 20 19:12:47 ventus kernel: Free swap = 0kB
May 20 19:12:47 ventus kernel: Total swap = 0kB
May 20 19:12:47 ventus kernel: 16776966 pages RAM
May 20 19:12:47 ventus kernel: 0 pages HighMem/MovableOnly
May 20 19:12:47 ventus kernel: 447358 pages reserved
May 20 19:12:47 ventus kernel: 0 pages cma reserved
May 20 19:12:47 ventus kernel: 0 pages hwpoisoned
May 20 19:12:47 ventus kernel: Tasks state (memory values in pages):
May 20 19:12:47 ventus kernel: [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name
May 20 19:12:47 ventus kernel: [ 788] 0 788 33741 22778 294912 0 -250 systemd-journal
May 20 19:12:47 ventus kernel: [ 806] 0 806 9522 973 90112 0 -1000 systemd-udevd
May 20 19:12:47 ventus kernel: [ 922] 0 922 4938 229 53248 0 -1000 auditd
May 20 19:12:47 ventus kernel: [ 948] 81 948 2669 160 57344 0 -900 dbus-broker-lau
May 20 19:12:47 ventus kernel: [ 949] 81 949 1288 128 49152 0 -900 dbus-broker
May 20 19:12:47 ventus kernel: [ 952] 0 952 32394 5645 155648 0 0 firewalld
May 20 19:12:47 ventus kernel: [ 953] 0 953 20685 128 61440 0 0 irqbalance
May 20 19:12:47 ventus kernel: [ 954] 0 954 5630 628 81920 0 0 systemd-logind
May 20 19:12:47 ventus kernel: [ 956] 0 956 4874 448 77824 0 0 VGAuthService
May 20 19:12:47 ventus kernel: [ 957] 0 957 60862 544 106496 0 0 vmtoolsd
May 20 19:12:47 ventus kernel: [ 962] 996 962 21252 115 69632 0 0 chronyd
May 20 19:12:47 ventus kernel: [ 967] 0 967 65101 736 143360 0 0 NetworkManager
May 20 19:12:47 ventus kernel: [ 1003] 0 1003 4400 512 73728 0 -1000 sshd
May 20 19:12:47 ventus kernel: [ 1010] 0 1010 64604 3339 126976 0 0 tuned
May 20 19:12:47 ventus kernel: [ 1014] 0 1014 2155 192 57344 0 0 crond
May 20 19:12:47 ventus kernel: [ 1016] 0 1016 761 96 45056 0 0 agetty
May 20 19:12:47 ventus kernel: [ 1087] 27 1087 830038 56773 876544 0 0 mariadbd
May 20 19:12:47 ventus kernel: [ 1120] 997 1120 729983 1351 262144 0 0 polkitd
May 20 19:12:47 ventus kernel: [ 1156] 0 1156 82157 3136 245760 0 0 rsyslogd
May 20 19:12:47 ventus kernel: [ 119490] 1000 119490 4330 320 69632 0 0 su
May 20 19:12:47 ventus kernel: [ 119532] 0 119532 2122 352 65536 0 0 bash
May 20 19:12:47 ventus kernel: [ 123391] 0 123391 207001071 1353437 11857920 0 0 java
May 20 19:12:47 ventus kernel: [ 123933] 0 123933 1529 96 53248 0 0 script
May 20 19:12:47 ventus kernel: [ 123935] 0 123935 1891 224 57344 0 0 bash
May 20 19:12:47 ventus kernel: [ 126185] 0 126185 1814 96 57344 0 0 bash
May 20 19:12:47 ventus kernel: [ 139238] 0 139238 5266 608 81920 0 0 sshd
May 20 19:12:47 ventus kernel: [ 139245] 1000 139245 5266 587 81920 0 0 sshd
May 20 19:12:47 ventus kernel: [ 139246] 1000 139246 1861 160 53248 0 0 bash
May 20 19:12:47 ventus kernel: [ 139295] 1000 139295 4330 320 69632 0 0 su
May 20 19:12:47 ventus kernel: [ 139326] 0 139326 1923 224 61440 0 0 bash
May 20 19:12:47 ventus kernel: [ 140040] 0 140040 1396 32 49152 0 0 sleep
May 20 19:12:47 ventus kernel: oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=/,mems_allowed=0,global_oom,task_memcg=/system.slice/sshd.service,task=java,pid=123391,uid=0
May 20 19:12:47 ventus kernel: Out of memory: Killed process 123391 (java) total-vm:828004284kB, anon-rss:551156kB, file-rss:0kB, shmem-rss:4862592kB, UID:0 pgtables:11580kB oom_score_adj:0


Подробнее здесь: https://stackoverflow.com/questions/796 ... oom-killer