Home » Mailing lists » Users » poor performance inside a VE
| poor performance inside a VE [message #10965] |
Sat, 10 March 2007 10:16  |
pookey
Messages: 12
Registered: March 2007
|
Junior Member |
|
|
Hi all,
A friend recently wanted to do some rendering, so I setup him up a VPS
quickly on an idle machine for him to render on.... however - it didn't
go so well.
Here's the output of dstat with the rendering goign on in VE0 (the host).
----total-cpu-usage---- -disk/total -net/total- ---paging-- ---system--
usr sys idl wai hiq siq|_read write|_recv _send|__in_ _out_|_int_ _csw_
17 1 82 0 0 0| 22k 637k| 0 0 | 0 0 | 236 948
54 0 46 0 0 0| 0 0 |2773B 4860B| 0 0 | 126 818
61 3 36 0 0 0| 0 16k| 596B 360B| 0 0 | 141 759
77 1 22 0 0 0| 0 0 |2835B 4840B| 0 0 | 118 707
81 1 18 0 0 0| 0 80k| 0 0 | 0 0 | 124 747
As you can see, it's using most of the CPU (there's 2 hyperthreading
xeons in this machine), and all is well. The render completes in about
30 minutes.
However... here's what happens when I run ths render inside a VE
----total-cpu-usage---- -disk/total -net/total- ---paging-- ---system--
usr sys idl wai hiq siq|_read write|_recv _send|__in_ _out_|_int_ _csw_
18 1 81 0 0 0| 22k 626k| 0 0 | 0 0 | 234 971
2 0 98 0 0 0| 0 0 |2675B 4500B| 0 0 | 120 11k
0 0 99 0 0 0| 0 16k| 0 0 | 0 0 | 126 12k
2 0 98 0 0 0| 0 0 |1999B 3730B| 0 0 | 121 9010
1 0 99 0 0 0| 0 16k| 0 0 | 0 0 | 125 11k
1 0 99 0 0 0| 0 0 |1935B 3730B| 0 0 | 116 10k
Notice the stupidly high number of context switches (last column). The
render on the VE is estimated to take about 10 times longer...
# in=spaceinvader.flam3 format=png transparency=false prefix="renderc"
verbose=1 flam3-render
Automatically detected 4 core(s)...
chaos: 0.5% ETA: 286.5 minutes
Can anyone suggest why this is?
--
Ian P. Christian ~ http://pookey.co.uk
|
|
|
|
| Re: poor performance inside a VE [message #10969 is a reply to message #10965] |
Sat, 10 March 2007 20:14  |
Sidnei Rodrigo Basei
Messages: 6
Registered: February 2007
|
Junior Member |
|
|
Hi Ian,
I am running JAVA applications and its performance is very poor, too.
To solve it, you can try setting the CPU_UNITS to other number, for
example (i am using now) CPUUNITS="100000".
Maybe you've problems with memory. In this case, you can see the
/prov/user_beancounters file and update its parameters.
You look the "maxheld" and "held" columns. If maxheld is equal to held
(or nearly), you must update the "barrier" and "limit" for this
paramenter ("resource").
Thats all ...
Sorry .. my english isn't so good =(
Sidnei
Ian P. Christian escreveu:
> Hi all,
>
> A friend recently wanted to do some rendering, so I setup him up a VPS
> quickly on an idle machine for him to render on.... however - it didn't
> go so well.
>
> Here's the output of dstat with the rendering goign on in VE0 (the host).
>
>
> ----total-cpu-usage---- -disk/total -net/total- ---paging-- ---system--
> usr sys idl wai hiq siq|_read write|_recv _send|__in_ _out_|_int_ _csw_
> 17 1 82 0 0 0| 22k 637k| 0 0 | 0 0 | 236 948
> 54 0 46 0 0 0| 0 0 |2773B 4860B| 0 0 | 126 818
> 61 3 36 0 0 0| 0 16k| 596B 360B| 0 0 | 141 759
> 77 1 22 0 0 0| 0 0 |2835B 4840B| 0 0 | 118 707
> 81 1 18 0 0 0| 0 80k| 0 0 | 0 0 | 124 747
>
>
> As you can see, it's using most of the CPU (there's 2 hyperthreading
> xeons in this machine), and all is well. The render completes in about
> 30 minutes.
>
>
> However... here's what happens when I run ths render inside a VE
> ----total-cpu-usage---- -disk/total -net/total- ---paging-- ---system--
> usr sys idl wai hiq siq|_read write|_recv _send|__in_ _out_|_int_ _csw_
> 18 1 81 0 0 0| 22k 626k| 0 0 | 0 0 | 234 971
> 2 0 98 0 0 0| 0 0 |2675B 4500B| 0 0 | 120 11k
> 0 0 99 0 0 0| 0 16k| 0 0 | 0 0 | 126 12k
> 2 0 98 0 0 0| 0 0 |1999B 3730B| 0 0 | 121 9010
> 1 0 99 0 0 0| 0 16k| 0 0 | 0 0 | 125 11k
> 1 0 99 0 0 0| 0 0 |1935B 3730B| 0 0 | 116 10k
>
>
> Notice the stupidly high number of context switches (last column). The
> render on the VE is estimated to take about 10 times longer...
>
> # in=spaceinvader.flam3 format=png transparency=false prefix="renderc"
> verbose=1 flam3-render
> Automatically detected 4 core(s)...
> chaos: 0.5% ETA: 286.5 minutes
>
>
> Can anyone suggest why this is?
>
>
--
Sidnei Rodrigo Basei <sidnei.basei@gmail.com>
55-48-8404-5932
"A opinião pública já mandou Cristo ao Calvário"
|
|
|
|
|
|
|
|
| Re: poor performance inside a VE [message #10984 is a reply to message #10982] |
Sun, 11 March 2007 08:32 |
pookey
Messages: 12
Registered: March 2007
|
Junior Member |
|
|
Kirill Korotaev wrote:
> - what kernel do you run?
> - is it binary one from openvz.org or compiled by yourself? (please provide .config then)
> - cat /proc/cpuinfo from host please
> - can you also provide output of top (then press '1') during the renderer working in VE
>
Hi Kir,
Kernel linux-2.6.18-openvz-028.018 - compiled myself, .config is attached.
# cat /proc/cpuinfo
processor : 0
vendor_id : GenuineIntel
cpu family : 15
model : 4
model name : Intel(R) Xeon(TM) CPU 3.20GHz
stepping : 3
cpu MHz : 3200.429
cache size : 2048 KB
physical id : 0
siblings : 2
core id : 0
cpu cores : 1
fdiv_bug : no
hlt_bug : no
f00f_bug : no
coma_bug : no
fpu : yes
fpu_exception : yes
cpuid level : 5
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge
mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe nx lm
constant_tsc pni monitor ds_cpl cid cx16 xtpr
bogomips : 6404.87
processor : 1
vendor_id : GenuineIntel
cpu family : 15
model : 4
model name : Intel(R) Xeon(TM) CPU 3.20GHz
stepping : 3
cpu MHz : 3200.429
cache size : 2048 KB
physical id : 0
siblings : 2
core id : 0
cpu cores : 1
fdiv_bug : no
hlt_bug : no
f00f_bug : no
coma_bug : no
fpu : yes
fpu_exception : yes
cpuid level : 5
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge
mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe nx lm
constant_tsc pni monitor ds_cpl cid cx16 xtpr
bogomips : 6400.76
processor : 2
vendor_id : GenuineIntel
cpu family : 15
model : 4
model name : Intel(R) Xeon(TM) CPU 3.20GHz
stepping : 3
cpu MHz : 3200.429
cache size : 2048 KB
physical id : 3
siblings : 2
core id : 0
cpu cores : 1
fdiv_bug : no
hlt_bug : no
f00f_bug : no
coma_bug : no
fpu : yes
fpu_exception : yes
cpuid level : 5
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge
mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe nx lm
constant_tsc pni monitor ds_cpl cid cx16 xtpr
bogomips : 6400.82
processor : 3
vendor_id : GenuineIntel
cpu family : 15
model : 4
model name : Intel(R) Xeon(TM) CPU 3.20GHz
stepping : 3
cpu MHz : 3200.429
cache size : 2048 KB
physical id : 3
siblings : 2
core id : 0
cpu cores : 1
fdiv_bug : no
hlt_bug : no
f00f_bug : no
coma_bug : no
fpu : yes
fpu_exception : yes
cpuid level : 5
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge
mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe nx lm
constant_tsc pni monitor ds_cpl cid cx16 xtpr
bogomips : 6400.81
Output of top:
top - 08:30:36 up 23:44, 2 users, load average: 0.75, 0.23, 0.08
Tasks: 74 total, 2 running, 72 sleeping, 0 stopped, 0 zombie
Cpu0 : 5.0% us, 3.7% sy, 0.0% ni, 91.4% id, 0.0% wa, 0.0% hi, 0.0% si
Cpu1 : 3.0% us, 3.3% sy, 0.0% ni, 93.7% id, 0.0% wa, 0.0% hi, 0.0% si
Cpu2 : 10.6% us, 3.3% sy, 0.0% ni, 86.0% id, 0.0% wa, 0.0% hi, 0.0% si
Cpu3 : 6.6% us, 4.7% sy, 0.0% ni, 88.7% id, 0.0% wa, 0.0% hi, 0.0% si
Mem: 2593088k total, 2066168k used, 526920k free, 299268k buffers
Swap: 1959920k total, 0k used, 1959920k free, 1204772k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
2217 root 15 0 347m 327m 1048 S 15 12.9 0:02.68 flam3-render
2219 root 16 0 347m 327m 1048 R 11 12.9 0:02.92 flam3-render
2216 root 15 0 347m 327m 1048 S 10 12.9 0:02.74 flam3-render
2218 root 18 0 347m 327m 1048 S 4 12.9 0:02.78 flam3-render
11 root 10 -5 0 0 0 S 0 0.0 0:00.17 events/1
1 root 16 0 1564 544 476 S 0 0.0 0:01.64 init
2 root RT 0 0 0 0 S 0 0.0 0:00.05 migration/0/0
Kind Regards,
--
Ian P. Christian ~ http://pookey.co.uk
#
# Automatically generated make config: don't edit
# Linux kernel version: 2.6.18-028test018
# Sat Mar 10 08:32:15 2007
#
CONFIG_X86_32=y
CONFIG_GENERIC_TIME=y
CONFIG_LOCKDEP_SUPPORT=y
CONFIG_STACKTRACE_SUPPORT=y
CONFIG_SEMAPHORE_SLEEPERS=y
CONFIG_X86=y
CONFIG_MMU=y
CONFIG_GENERIC_ISA_DMA=y
CONFIG_GENERIC_IOMAP=y
CONFIG_GENERIC_HWEIGHT=y
CONFIG_ARCH_MAY_HAVE_PC_FDC=y
CONFIG_DMI=y
CONFIG_DEFCONFIG_LIST="/lib/modules/$UNAME_RELEASE/.config"
#
# Code maturity level options
#
CONFIG_EXPERIMENTAL=y
CONFIG_LOCK_KERNEL=y
CONFIG_INIT_ENV_ARG_LIMIT=32
#
# General setup
#
CONFIG_LOCALVERSION=""
CONFIG_LOCALVERSION_AUTO=y
CONFIG_SWAP=y
CONFIG_SYSVIPC=y
CONFIG_IPC_NS=y
CONFIG_POSIX_MQUEUE=y
# CONFIG_BSD_PROCESS_ACCT is not set
# CONFIG_TASKSTATS is not set
CONFIG_UTS_NS=y
CONFIG_AUDIT=y
CONFIG_AUDITSYSCALL=y
# CONFIG_IKCONFIG is not set
# CONFIG_CPUSETS is not set
# CONFIG_RELAY is not set
CONFIG_INITRAMFS_SOURCE=""
# CONFIG_CC_OPTIMIZE_FOR_SIZE is not set
# CONFIG_EMBEDDED is not set
CONFIG_UID16=y
# CONFIG_TASK_IO_ACCOUNTING is not set
CONFIG_SYSCTL=y
CONFIG_KALLSYMS=y
# CONFIG_KALLSYMS_EXTRA_PASS is not set
CONFIG_HOTPLUG=y
CONFIG_PRINTK=y
CONFIG_BUG=y
CONFIG_ELF_CORE=y
CONFIG_BASE_FULL=y
CONFIG_FUTEX=y
CONFIG_EPOLL=y
CONFIG_SHMEM=y
CONFIG_SLAB=y
CONFIG_VM_EVENT_COUNTERS=y
CONFIG_RT_MUTEXES=y
# CONFIG_TINY_SHMEM is not set
CONFIG_BASE_SMALL=0
# CONFIG_SLOB is not set
#
# Loadable module support
#
CONFIG_MODULES=y
# CONFIG_MODULE_UNLOAD is not set
# CONFIG_MODVERSIONS is not set
# CONFIG_MODULE_SRCVERSION_ALL is not set
CONFIG_KMOD=y
#
# Block layer
#
CONFIG_LBD=y
# CONFIG_BLK_DEV_IO_TRACE is not set
# CONFIG_LSF is not set
#
# IO Schedulers
#
CONFIG_IOSCHED_NOOP=y
CONFIG_IOSCHED_AS=y
CONFIG_IOSCHED_DEADLINE=y
CONFIG_IOSCHED_CFQ=y
CONFIG_DEFAULT_AS=y
# CONFIG_DEFAULT_DEADLINE is not set
# CONFIG_DEFAULT_CFQ is not set
# CONFIG_DEFAULT_NOOP is not set
CONFIG_DEFAULT_IOSCHED="anticipatory"
#
# Processor type and features
#
CONFIG_SMP=y
CONFIG_X86_PC=y
# CONFIG_X86_ELAN is not set
# CONFIG_X86_VOYAGER is not set
# CONFIG_X86_NUMAQ is not set
# CONFIG_X86_SUMMIT is not set
# CONFIG_X86_BIGSMP is not set
# CONFIG_X86_VISWS is not set
# CONFIG_X86_GENERICARCH is not set
# CONFIG_X86_ES7000 is not set
# CONFIG_M386 is not set
# CONFIG_M486 is not set
# CONFIG_M586 is not set
# CONFIG_M586TSC is not set
# CONFIG_M586MMX is not set
# CONFIG_M686 is not set
# CONFIG_MPENTIUMII is not set
# CONFIG_MPENTIUMIII is not set
# CONFIG_MPENTIUMM is not set
CONFIG_MPENTIUM4=y
# CONFIG_MK6 is not set
# CONFIG_MK7 is not set
# CONFIG_MK8 is not set
# CONFIG_MCRUSOE is not set
# CONFIG_MEFFICEON is not set
# CONFIG_MWINCHIPC6 is not set
# CONFIG_MWINCHIP2 is not set
# CONFIG_MWINCHIP3D is not set
# CONFIG_MGEODEGX1 is not set
# CONFIG_MGEODE_LX is not set
# CONFIG_MCYRIXIII is not set
# CONFIG_MVIAC3_2 is not set
# CONFIG_X86_GENERIC is not set
CONFIG_X86_CMPXCHG=y
CONFIG_X86_XADD=y
CONFIG_X86_L1_CACHE_SHIFT=7
CONFIG_RWSEM_XCHGADD_ALGORITHM=y
CONFIG_GENERIC_CALIBRATE_DELAY=y
CONFIG_X86_WP_WORKS_OK=y
CONFIG_X86_INVLPG=y
CONFIG_X86_BSWAP=y
CONFIG_X86_POPAD_OK=y
CONFIG_X86_CMPXCHG64=y
CONFIG_X86_GOOD_APIC=y
CONFIG_X86_INTEL_USERCOPY=y
CONFIG_X86_USE_PPRO_CHECKSUM=y
CONFIG_X86_TSC=y
# CONFIG_HPET_TIMER is not set
CONFIG_NR_CPUS=4
CONFIG_SCHED_VCPU=y
CONFIG_FAIRSCHED=y
CONFIG_SCHED_SMT=y
CONFIG_SCHED_MC=y
CONFIG_PREEMPT_NONE=y
# CONFIG_PREEMPT_VOLUNTARY is not set
# CONFIG_PREEMPT is not set
CONFIG_PREEMPT_BKL=y
CONFIG_X86_LOCAL_APIC=y
CONFIG_X86_IO_APIC=y
CONFIG_NMI_WATCHDOG=y
CONFIG_X86_MCE=y
CONFIG_X86_MCE_NONFATAL=y
CONFIG_X86_MCE_P4THERMAL=y
CONFIG_VM86=y
# CONFIG_TOSHIBA is not set
# CONFIG_I8K is not set
# CONFIG_X86_REBOOTFIXUPS is not set
# CONFIG_MICROCODE is not set
# CONFIG_X86_MSR is not set
# CONFIG_X86_CPUID is not set
#
# Firmware Drivers
#
# CONFIG_EDD is not set
# CONFIG_DELL_RBU is not set
# CONFIG_DCDBAS is not set
# CONFIG_NOHIGHMEM is not set
CONFIG_HIGHMEM4G=y
# CONFIG_HIGHMEM64G is not set
CONFIG_PAGE_OFFSET=0xC0000000
CONFIG_HIGHMEM=y
CONFIG_ARCH_FLATMEM_ENABLE=y
CONFIG_ARCH_SPARSEMEM_ENABLE=y
CONFIG_ARCH_SELECT_MEMORY_MODEL=y
CONFIG_SELECT_MEMORY_MODEL=y
CONFIG_FLATMEM_MANUAL=y
# CONFIG_DISCONTIGMEM_MANUAL is not set
# CONFIG_SPARSEMEM_MANUAL is not set
CONFIG_FLATMEM=y
CONFIG_FLAT_NODE_MEM_MAP=y
CONFIG_SPARSEMEM_STATIC=y
CONFIG_SPLIT_PTLOCK_CPUS=4
# CONFIG_RESOURCES_64BIT is not set
# CONFIG_HIGHPTE is not set
# CONFIG_MATH_EMULATION is not set
CONFIG_MTRR=y
# CONFIG_EFI is not set
CONFIG_IRQBALANCE=y
# CONFIG_REGPARM is not set
CONFIG_SECCOMP=y
CONFIG_HZ_100=y
# CONFIG_HZ_250 is not set
# CONFIG_HZ_1000 is not set
CONFIG_HZ=100
CONFIG_KEXEC=y
# CONFIG_CRASH_DUMP is not set
CONFIG_PHYSICAL_START=0x100000
CONFIG_COMPAT_VDSO=y
CONFIG_ARCH_ENABLE_MEMORY_HOTPLUG=y
#
# Power management options (ACPI, APM)
#
CONFIG_PM=y
CONFIG_PM_LEGACY=y
# CONFIG_PM_DEBUG is not set
CONFIG_SOFTWARE_SUSPEND=y
CONFIG_PM_STD_PARTITION=""
#
# ACPI (Advanced Configuration and Power Interface) Support
#
CONFIG_ACPI=y
CONFIG_ACPI_AC=y
CONFIG_ACPI_BATTERY=y
CONFIG_ACPI_BUTTON=y
CONFIG_ACPI_VIDEO=y
# CONFIG_ACPI_HOTKEY is not set
CONFIG_ACPI_FAN=y
# CONFIG_ACPI_DOCK is not set
CONFIG_ACPI_PROCESSOR=y
CONFIG_ACPI_THERMAL=y
# CONFIG_ACPI_ASUS is not set
# CONFIG_ACPI_IBM is not set
# CONFIG_ACPI_TOSHIBA is not set
CONFIG_ACPI_BLACKLIST_YEAR=0
# CONFIG_ACPI_DEBUG is not set
CONFIG_ACPI_EC=y
CONFIG_ACPI_POWER=y
CONFIG_ACPI_SYSTEM=y
CONFIG_X86_PM_TIMER=y
# CONFIG_ACPI_CONTAINER is not set
#
# APM (Advanced Power Management) BIOS Support
#
# CONFIG_APM is not set
#
# CPU Frequency scaling
#
# CONFIG_CPU_
...
|
|
|
|
| Re: poor performance inside a VE [message #10997 is a reply to message #10965] |
Sun, 11 March 2007 12:29 |
pookey
Messages: 12
Registered: March 2007
|
Junior Member |
|
|
Ian P. Christian wrote:
> Hi all,
>
> A friend recently wanted to do some rendering, so I setup him up a VPS
> quickly on an idle machine for him to render on.... however - it didn't
> go so well.
Kirill logged into my openVZ host and looked into this problem for me -
and solved it. It wasn't an openVZ problem at all, it was simply that
the glibc inside the VE didn't have nptl support, where as the host did.
Many Thanks to Kirill for amazing support!
--
Ian P. Christian ~ http://pookey.co.uk
|
|
|
|
Goto Forum:
Current Time: Sun May 05 08:32:57 GMT 2024
Total time taken to generate the page: 0.02007 seconds
|
OpenVZ Forum
Members
Search
Help
Register
Login
Home
