Hi Rob,

My mistake, this is Oracle Enterprise Linux. 

cat /etc/oracle-release
Oracle Linux Server release 7.4

uname -a
Linux FQDN 3.8.13-118.19.7.el7uek.x86_64 #2 SMP Fri Sep 15 18:15:47 PDT 2017 x86_64 x86_64 x86_64 GNU/Linux

This is also a VM on Xen hypervisor, wuth HVM virtualization with PV drivers. Architecture x64.

I've switched to RHEL kernel and cheked /proc/meminfo and uname -a there:

uname -a
Linux FQDN 3.10.0-693.2.2.el7.x86_64 #1 SMP Tue Sep 12 10:49:01 PDT 2017 x86_64 x86_64 x86_64 GNU/Linux

cat /proc/meminfo
MemTotal:       16266720 kB
MemFree:        13897532 kB
MemAvailable:   14463308 kB


MemAvailable exists.

Will try to install using RHEL kernel.
Any other ways to install using OEL Kernel?

Regards,
Andrey

2017-10-04 23:20 GMT+03:00 Mark Reynolds <mareynol@redhat.com>:


On 10/04/2017 04:03 PM, Mark Reynolds via FreeIPA-users wrote:
>
> On 10/04/2017 01:30 PM, Rob Crittenden via FreeIPA-users wrote:
>> Markovich via FreeIPA-users wrote:
>>> Hello freeipa-users!
>>>
>>> I'm trying to install ipa-server-4.5.0-21.0.1.el7_4.1.2.x86_64 on Red Hat Enterprise Linux Server release 7.4 (Maipo) but getting error:
>>>
>>> [Setup] Info Could not import LDIF file '/var/lib/dirsrv/boot.ldif'.  Error: 768.  Output: importing data ...
>>> [04/Oct/2017:11:55:53.798978140 -0400] - ERR - spal_meminfo_get - Unable to retrieve /proc/meminfo : MemAvailable:
>>> ...
>>>
>> Hmm, very strange that MemAvailable is not in /proc/meminfo. Is this
>> bare metal, a VM (what type), what architecture?
> That value is hardcoded:
>
>     char *f_meminfo = "/proc/meminfo";
>     char *p_memtotal = "MemTotal:";
>     char *p_memavail = "MemAvailable:";
>     ...
>     ...
>     if (_spal_uint64_t_file_get(f_meminfo, p_memavail, &memavail)) {
>         slapi_log_err(SLAPI_LOG_ERR, "spal_meminfo_get", "Unable to
> retrieve %s : %s\n", f_meminfo, p_memavail);
>     }
>
> However, these "errors" probably have nothing to do with the import
> failure.  Are there any more messages in the Directory Server's errors log?
Sorry I missed the logging below...  Now this is a problem:

[04/Oct/2017:11:55:53.963334442 -0400] - INFO - check_and_set_import_cache - pagesize: 4096, available bytes 9223372030878334975, process usage 13570048
[04/Oct/2017:11:55:53.964858651 -0400] - INFO - check_and_set_import_cache - Import allocates 144115185741308KB import cache.

Those values are NOT correct, and they are coming from spal_meminfo_get().  It looks like spal_meminfo_get() might not be properly handling this error condition (as Rob previously noted).

Please file a ticket so we can investigate this:

https://pagure.io/389-ds-base/new_issue

Thanks,
Mark

 

>> There is some error handling around not retrieving this but it seems to
>> not be working. Sure seems like it is picking some rather humongous
>> values, or it is considering a bad memory pointer to be an int or something.
>>
>> rob
>>
>>
>>> cat /proc/meminfo
>>> MemTotal:       16170720 kB
>>> MemFree:         9051152 kB
>>> Buffers:           11280 kB
>>> Cached:          3490240 kB
>>> SwapCached:            0 kB
>>> Active:          5041772 kB
>>> Inactive:        1337116 kB
>>> Active(anon):    2878404 kB
>>> Inactive(anon):     8128 kB
>>> Active(file):    2163368 kB
>>> Inactive(file):  1328988 kB
>>> Unevictable:           0 kB
>>> Mlocked:               0 kB
>>> SwapTotal:       2097148 kB
>>> SwapFree:        2097148 kB
>>> Dirty:               400 kB
>>> Writeback:             0 kB
>>> AnonPages:       2877664 kB
>>> Mapped:            66880 kB
>>> Shmem:              8876 kB
>>> Slab:             562760 kB
>>> SReclaimable:     519908 kB
>>> SUnreclaim:        42852 kB
>>> KernelStack:        7408 kB
>>> PageTables:        12624 kB
>>> NFS_Unstable:          0 kB
>>> Bounce:                0 kB
>>> WritebackTmp:          0 kB
>>> CommitLimit:    10182508 kB
>>> Committed_AS:    5700160 kB
>>> VmallocTotal:   34359738367 kB
>>> VmallocUsed:       31364 kB
>>> VmallocChunk:   34359694544 kB
>>> HardwareCorrupted:     0 kB
>>> HugePages_Total:       0
>>> HugePages_Free:        0
>>> HugePages_Rsvd:        0
>>> HugePages_Surp:        0
>>> Hugepagesize:       2048 kB
>>> DirectMap4k:        8192 kB
>>> DirectMap2M:     2088960 kB
>>> DirectMap1G:    14680064 kB
>>>
>>>  My command:
>>>
>>> ipa-server-install --hostname=myhostname --domain=mydomain.com --realm=MYDOMAIN.COM --ds-password=password--master-password=password--admin-password=password--unattended --debug
>>>
>>> And on the second step:
>>>
>>> Done configuring NTP daemon (ntpd).
>>> Configuring directory server (dirsrv). Estimated time: 30 seconds
>>>   [1/45]: creating directory server instance
>>>   [error] RuntimeError: failed to create DS instance Command '/usr/sbin/setup-ds.pl --silent --logfile - -f /tmp/tmpPQPUX_' returned non-zero exit status 1
>>>
>>>
>>> More debug info is here:
>>>
>>> 2017-10-04T15:55:52Z DEBUG calling setup-ds.pl
>>> 2017-10-04T15:55:52Z DEBUG Starting external process
>>> 2017-10-04T15:55:52Z DEBUG args=/usr/sbin/setup-ds.pl --silent --logfile - -f /tmp/tmpPQPUX_
>>> 2017-10-04T15:55:56Z DEBUG Process finished, return code=1
>>> 2017-10-04T15:55:56Z DEBUG stdout=[17/10/04:11:55:56] - [Setup] Info Could not import LDIF file '/var/lib/dirsrv/boot.ldif'.  Error: 768.  Output: importing data ...
>>> [04/Oct/2017:11:55:53.798978140 -0400] - ERR - spal_meminfo_get - Unable to retrieve /proc/meminfo : MemAvailable:
>>> [04/Oct/2017:11:55:53.900526100 -0400] - INFO - ldbm_instance_config_cachememsize_set - force a minimal value 512000
>>> [04/Oct/2017:11:55:53.902864577 -0400] - ERR - spal_meminfo_get - Unable to retrieve /proc/meminfo : MemAvailable:
>>> [04/Oct/2017:11:55:53.923965959 -0400] - ERR - spal_meminfo_get - Unable to retrieve /proc/meminfo : MemAvailable:
>>> [04/Oct/2017:11:55:53.945262395 -0400] - ERR - spal_meminfo_get - Unable to retrieve /proc/meminfo : MemAvailable:
>>> [04/Oct/2017:11:55:53.953918605 -0400] - INFO - dblayer_instance_start - Import is running with nsslapd-db-private-import-mem on; No other process is allowed to access                                                                      the database
>>> [04/Oct/2017:11:55:53.961341875 -0400] - ERR - spal_meminfo_get - Unable to retrieve /proc/meminfo : MemAvailable:
>>> [04/Oct/2017:11:55:53.963334442 -0400] - INFO - check_and_set_import_cache - pagesize: 4096, available bytes 9223372030878334975, process usage 13570048
>>> [04/Oct/2017:11:55:53.964858651 -0400] - INFO - check_and_set_import_cache - Import allocates 144115185741308KB import cache.
>>> [04/Oct/2017:11:55:53.966412876 -0400] - ERR - spal_meminfo_get - Unable to retrieve /proc/meminfo : MemAvailable:
>>> [04/Oct/2017:11:55:53.968456383 -0400] - NOTICE - dblayer_select_ncache - Setting ncache to: 34359738 to keep each chunk below 4Gbytes
>>> tcmalloc: large alloc 1649270784 bytes == 0x7f370367e000 @  0x7f36ffd8cbf3 0x7f36ffdaccf2 0x7f36f751bb25 0x7f36f74e5c17 0x7f36f74ef019 0x7f36f74e9260 0x7f36f74e9a40 0x7                                                                     f36f335bf61 0x7f36f33a32ff 0x7f37009720e2 0x7f36fd5a1c05 0x7f3700972ad7
>>> tcmalloc: large alloc 584852226048 bytes == (nil) @  0x7f36ffd8cbf3 0x7f36ffdaccf2 0x7f36f751bb25 0x7f36f74e5c17 0x7f36f74a7d4a 0x7f36f74e92fc 0x7f36f74e9a40 0x7f36f335                                                                     bf61 0x7f36f33a32ff 0x7f37009720e2 0x7f36fd5a1c05 0x7f3700972ad7
>>> [04/Oct/2017:11:55:55.213645769 -0400] - ERR - libdb - BDB0147 malloc: 584852224468: Cannot allocate memory
>>> [04/Oct/2017:11:55:55.233320159 -0400] - ERR - libdb - BDB2014 Unable to allocate memory for mutexes from the region
>>> [04/Oct/2017:11:55:55.244128535 -0400] - ERR - libdb - BDB0061 PANIC: Cannot allocate memory
>>> tcmalloc: large alloc 1649270784 bytes == 0x7f370367e000 @  0x7f36ffd8cbf3 0x7f36ffdaccf2 0x7f36f751bb25 0x7f36f74e5c17 0x7f36f74ef019 0x7f36f74f0023 0x7f36f74e961c 0x7                                                                     f36f74e9a40 0x7f36f335bf61 0x7f36f33a32ff 0x7f37009720e2 0x7f36fd5a1c05 0x7f3700972ad7
>>> [04/Oct/2017:11:55:56.472105344 -0400] - ERR - libdb - BDB1544 process-private: unable to find environment
>>> [04/Oct/2017:11:55:56.481460130 -0400] - ERR - dblayer_instance_start - Unable to open new DB_ENV for import/export! -30973
>>> [04/Oct/2017:11:55:56.483212941 -0400] - ERR - dblayer_instance_start - Failure BDB0087 DB_RUNRECOVERY: Fatal error, run database recovery (-30973)
>>>
>>> Could not import LDIF file '/var/lib/dirsrv/boot.ldif'.  Error: 768.  Output: importing data ...
>>> [04/Oct/2017:11:55:53.798978140 -0400] - ERR - spal_meminfo_get - Unable to retrieve /proc/meminfo : MemAvailable:
>>> [04/Oct/2017:11:55:53.900526100 -0400] - INFO - ldbm_instance_config_cachememsize_set - force a minimal value 512000
>>> [04/Oct/2017:11:55:53.902864577 -0400] - ERR - spal_meminfo_get - Unable to retrieve /proc/meminfo : MemAvailable:
>>> [04/Oct/2017:11:55:53.923965959 -0400] - ERR - spal_meminfo_get - Unable to retrieve /proc/meminfo : MemAvailable:
>>> [04/Oct/2017:11:55:53.945262395 -0400] - ERR - spal_meminfo_get - Unable to retrieve /proc/meminfo : MemAvailable:
>>> [04/Oct/2017:11:55:53.953918605 -0400] - INFO - dblayer_instance_start - Import is running with nsslapd-db-private-import-mem on; No other process is allowed to access                                                                      the database
>>> [04/Oct/2017:11:55:53.961341875 -0400] - ERR - spal_meminfo_get - Unable to retrieve /proc/meminfo : MemAvailable:
>>> [04/Oct/2017:11:55:53.963334442 -0400] - INFO - check_and_set_import_cache - pagesize: 4096, available bytes 9223372030878334975, process usage 13570048
>>> [04/Oct/2017:11:55:53.964858651 -0400] - INFO - check_and_set_import_cache - Import allocates 144115185741308KB import cache.
>>> [04/Oct/2017:11:55:53.966412876 -0400] - ERR - spal_meminfo_get - Unable to retrieve /proc/meminfo : MemAvailable:
>>> [04/Oct/2017:11:55:53.968456383 -0400] - NOTICE - dblayer_select_ncache - Setting ncache to: 34359738 to keep each chunk below 4Gbytes
>>> tcmalloc: large alloc 1649270784 bytes == 0x7f370367e000 @  0x7f36ffd8cbf3 0x7f36ffdaccf2 0x7f36f751bb25 0x7f36f74e5c17 0x7f36f74ef019 0x7f36f74e9260 0x7f36f74e9a40 0x7                                                                     f36f335bf61 0x7f36f33a32ff 0x7f37009720e2 0x7f36fd5a1c05 0x7f3700972ad7
>>> tcmalloc: large alloc 584852226048 bytes == (nil) @  0x7f36ffd8cbf3 0x7f36ffdaccf2 0x7f36f751bb25 0x7f36f74e5c17 0x7f36f74a7d4a 0x7f36f74e92fc 0x7f36f74e9a40 0x7f36f335                                                                     bf61 0x7f36f33a32ff 0x7f37009720e2 0x7f36fd5a1c05 0x7f3700972ad7
>>> [04/Oct/2017:11:55:55.213645769 -0400] - ERR - libdb - BDB0147 malloc: 584852224468: Cannot allocate memory
>>> [04/Oct/2017:11:55:55.233320159 -0400] - ERR - libdb - BDB2014 Unable to allocate memory for mutexes from the region
>>> [04/Oct/2017:11:55:55.244128535 -0400] - ERR - libdb - BDB0061 PANIC: Cannot allocate memory
>>> tcmalloc: large alloc 1649270784 bytes == 0x7f370367e000 @  0x7f36ffd8cbf3 0x7f36ffdaccf2 0x7f36f751bb25 0x7f36f74e5c17 0x7f36f74ef019 0x7f36f74f0023 0x7f36f74e961c 0x7                                                                     f36f74e9a40 0x7f36f335bf61 0x7f36f33a32ff 0x7f37009720e2 0x7f36fd5a1c05 0x7f3700972ad7
>>> [04/Oct/2017:11:55:56.472105344 -0400] - ERR - libdb - BDB1544 process-private: unable to find environment
>>> [04/Oct/2017:11:55:56.481460130 -0400] - ERR - dblayer_instance_start - Unable to open new DB_ENV for import/export! -30973
>>> [04/Oct/2017:11:55:56.483212941 -0400] - ERR - dblayer_instance_start - Failure BDB0087 DB_RUNRECOVERY: Fatal error, run database recovery (-30973)
>>>
>>> [17/10/04:11:55:56] - [Setup] Fatal Error: Could not create directory server instance 'MYDOMAIN-COM'.
>>> Error: Could not create directory server instance 'MYDOMAIN-COM'.
>>> [17/10/04:11:55:56] - [Setup] Fatal Exiting . . .
>>> Log file is '-'
>>>
>>> Exiting . . .
>>> Log file is '-'
>>>
>>>
>>> 2017-10-04T15:55:56Z DEBUG stderr=
>>> 2017-10-04T15:55:56Z DEBUG Traceback (most recent call last):
>>>   File "/usr/lib/python2.7/site-packages/ipaserver/install/service.py", line 504, in start_creation
>>>     run_step(full_msg, method)
>>>   File "/usr/lib/python2.7/site-packages/ipaserver/install/service.py", line 494, in run_step
>>>     method()
>>>   File "/usr/lib/python2.7/site-packages/ipaserver/install/dsinstance.py", line 559, in __create_instance
>>>     raise RuntimeError("failed to create DS instance %s" % e)
>>> RuntimeError: failed to create DS instance Command '/usr/sbin/setup-ds.pl --silent --logfile - -f /tmp/tmpPQPUX_' returned non-zero exit status 1
>>>
>>> 2017-10-04T15:55:56Z DEBUG   [error] RuntimeError: failed to create DS instance Command '/usr/sbin/setup-ds.pl --silent --logfile - -f /tmp/tmpPQPUX_' returned non-zero                                                                      exit status 1
>>> 2017-10-04T15:55:56Z DEBUG   File "/usr/lib/python2.7/site-packages/ipapython/admintool.py", line 172, in execute
>>>     return_value = self.run()
>>>   File "/usr/lib/python2.7/site-packages/ipapython/install/cli.py", line 333, in run
>>>     cfgr.run()
>>>   File "/usr/lib/python2.7/site-packages/ipapython/install/core.py", line 368, in run
>>>     self.execute()
>>>   File "/usr/lib/python2.7/site-packages/ipapython/install/core.py", line 392, in execute
>>>     for _nothing in self._executor():
>>>   File "/usr/lib/python2.7/site-packages/ipapython/install/core.py", line 434, in __runner
>>>     exc_handler(exc_info)
>>>   File "/usr/lib/python2.7/site-packages/ipapython/install/core.py", line 463, in _handle_execute_exception
>>>     self._handle_exception(exc_info)
>>>   File "/usr/lib/python2.7/site-packages/ipapython/install/core.py", line 453, in _handle_exception
>>>     six.reraise(*exc_info)
>>>   File "/usr/lib/python2.7/site-packages/ipapython/install/core.py", line 424, in __runner
>>>     step()
>>>   File "/usr/lib/python2.7/site-packages/ipapython/install/core.py", line 421, in <lambda>
>>>     step = lambda: next(self.__gen)
>>>   File "/usr/lib/python2.7/site-packages/ipapython/install/util.py", line 81, in run_generator_with_yield_from
>>>     six.reraise(*exc_info)
>>>   File "/usr/lib/python2.7/site-packages/ipapython/install/util.py", line 59, in run_generator_with_yield_from
>>>     value = gen.send(prev_value)
>>>   File "/usr/lib/python2.7/site-packages/ipapython/install/core.py", line 658, in _configure
>>>     next(executor)
>>>   File "/usr/lib/python2.7/site-packages/ipapython/install/core.py", line 434, in __runner
>>>     exc_handler(exc_info)
>>>   File "/usr/lib/python2.7/site-packages/ipapython/install/core.py", line 463, in _handle_execute_exception
>>>     self._handle_exception(exc_info)
>>>   File "/usr/lib/python2.7/site-packages/ipapython/install/core.py", line 521, in _handle_exception
>>>     self.__parent._handle_exception(exc_info)
>>>   File "/usr/lib/python2.7/site-packages/ipapython/install/core.py", line 453, in _handle_exception
>>>     six.reraise(*exc_info)
>>>   File "/usr/lib/python2.7/site-packages/ipapython/install/core.py", line 518, in _handle_exception
>>>     super(ComponentBase, self)._handle_exception(exc_info)
>>>   File "/usr/lib/python2.7/site-packages/ipapython/install/core.py", line 453, in _handle_exception
>>>     six.reraise(*exc_info)
>>>   File "/usr/lib/python2.7/site-packages/ipapython/install/core.py", line 424, in __runner
>>>     step()
>>>   File "/usr/lib/python2.7/site-packages/ipapython/install/core.py", line 421, in <lambda>
>>>     step = lambda: next(self.__gen)
>>>   File "/usr/lib/python2.7/site-packages/ipapython/install/util.py", line 81, in run_generator_with_yield_from
>>>     six.reraise(*exc_info)
>>>   File "/usr/lib/python2.7/site-packages/ipapython/install/util.py", line 59, in run_generator_with_yield_from
>>>     value = gen.send(prev_value)
>>>   File "/usr/lib/python2.7/site-packages/ipapython/install/common.py", line 63, in _install
>>>     for _nothing in self._installer(self.parent):
>>>   File "/usr/lib/python2.7/site-packages/ipaserver/install/server/__init__.py", line 578, in main
>>>     master_install(self)
>>>   File "/usr/lib/python2.7/site-packages/ipaserver/install/server/install.py", line 248, in decorated
>>>     func(installer)
>>>   File "/usr/lib/python2.7/site-packages/ipaserver/install/server/install.py", line 758, in install
>>>     setup_pkinit=not options.no_pkinit)
>>>   File "/usr/lib/python2.7/site-packages/ipaserver/install/dsinstance.py", line 344, in create_instance
>>>     self.start_creation(runtime=30)
>>>   File "/usr/lib/python2.7/site-packages/ipaserver/install/service.py", line 504, in start_creation
>>>     run_step(full_msg, method)
>>>   File "/usr/lib/python2.7/site-packages/ipaserver/install/service.py", line 494, in run_step
>>>     method()
>>>   File "/usr/lib/python2.7/site-packages/ipaserver/install/dsinstance.py", line 559, in __create_instance
>>>     raise RuntimeError("failed to create DS instance %s" % e)
>>>
>>> 2017-10-04T15:55:56Z DEBUG The ipa-server-install command failed, exception: RuntimeError: failed to create DS instance Command '/usr/sbin/setup-ds.pl --silent --logfil                                                                     e - -f /tmp/tmpPQPUX_' returned non-zero exit status 1
>>> 2017-10-04T15:55:56Z ERROR failed to create DS instance Command '/usr/sbin/setup-ds.pl --silent --logfile - -f /tmp/tmpPQPUX_' returned non-zero exit status 1
>>> 2017-10-04T15:55:56Z ERROR The ipa-server-install command failed. See /var/log/ipaserver-install.log for more information
>>>
>>>
>>> Regards,
>>> Andrey
>>> _______________________________________________
>>> FreeIPA-users mailing list -- freeipa-users@lists.fedorahosted.org
>>> To unsubscribe send an email to freeipa-users-leave@lists.fedorahosted.org
>>>
>> _______________________________________________
>> FreeIPA-users mailing list -- freeipa-users@lists.fedorahosted.org
>> To unsubscribe send an email to freeipa-users-leave@lists.fedorahosted.org
> _______________________________________________
> FreeIPA-users mailing list -- freeipa-users@lists.fedorahosted.org
> To unsubscribe send an email to freeipa-users-leave@lists.fedorahosted.org