Restoring a backup from 2.6.2 to 5.0.x succeeds, but backend reports 0 entries

[chrisgolle]

Hi, im having some trouble restoring a backup from v 2.6.2 to try and upgrade to 5.0.x. The backup seems to restore successfully without error, but then starting the directory the backend reports 0 entries. The same backup restores successfully on another instance of 2.6.2. It doesnt seem like any error logs appear indicating what could be the issue. Any help or suggestions to debug would be greatly appreciated. Going to attempt 4.x and 3.x to see if i experience different results.

[vharseko]

Attach a backup example or try upgrade or export/import

[chrisgolle]

Thank you for the support. unfortunately a backup example is too large... but I will try the upgrade. I am confident an ldif export then import would work or at least emit errors why but I was hoping to make use of existing backups. I will report back on upgrade results. for simplicity it would have been ideal for the simple restore of a backup to work.

[chrisgolle]

the upgrade gets through the main part updating from 2.6.2 to 5.0.2 with java 21,

>>>> OpenDJ was successfully upgraded from version 2.6.2.-1 to
5.0.2.16fb4328facfa08d2d6beb68a8d607bdf0ef5e15


>>>> Performing post upgrade tasks

  Rebuilding all indexes..............................................   FAIL
  [!] An error occurred during post upgrade task. Process aborted. Please
  check log for further details

but on post upgrade rebuilding rebuilding indices fails after reaching a certain point, from the log:

[12/Feb/2026:13:58:05 -0500] category=TOOLS severity=ERROR msgID=852 msg=An error occurred while attempting to perform index rebuild:  com.sleepycat.je.EnvironmentFailureException: (JE 18.3.12) Environment must be closed, caused by: com.sleepycat.je.EnvironmentFailureException: Environment invalid because of previous exception: (JE 18.3.12) /opendj/db/userRoot fetchIN of 0x340/0x48e995 parent IN=2392616 IN class=com.sleepycat.je.tree.IN lastFullLsn=0xffffffff/0xffffffff lastLoggedLsn=0xffffffff/0xffffffff parent.getDirty()=false state=0 expires=never SortedLSNTreeWalker failed dbId=35 isOffHeapBinInTree=false isLnInOffHeapBin=false deltaObject=false residentNode=false LOG_FILE_NOT_FOUND: Log file missing, log is likely invalid. Environment is invalid and must be closed. fetchLN of 0x51/0x24e295d parent IN=87341 IN class=com.sleepycat.je.tree.BIN lastFullLsn=0x51/0x24f4881 lastLoggedLsn=0x51/0x24f4881 parent.getDirty()=false state=0 expires=never (id=null--1)
An error occurs during the rebuild index process in c=CA, rebuild index(es) aborted.

Attempting to start the DS reports the following. Indeed, the file its looking for /opendj/db/userRoot/00000340.jdb is absent, this file di exist in the original db though. There are 7 less files in userRoot post-upgrade.

[12/Feb/2026:14:19:21 -0500] category=BACKEND severity=NOTICE msgID=513 msg=The database backend userRoot containing 0 entries has started
[12/Feb/2026:14:19:21 -0500] category=EXTENSIONS severity=NOTICE msgID=221 msg=DIGEST-MD5 SASL mechanism using a server fully qualified domain name of: Macbook-GH6Q7H6YTG.local
Feb 12, 2026 2:19:21 P.M. com.sleepycat.je.utilint.DaemonThread run
SEVERE: <DaemonThread name="Cleaner-4"/> caught exception, com.sleepycat.je.EnvironmentFailureException: (JE 18.3.12) Environment must be closed, caused by: com.sleepycat.je.EnvironmentFailureException: Environment invalid because of previous exception: (JE 18.3.12) /opendj/db/userRoot fetchIN of 0x340/0x48e9d8 parent IN=5277169 IN class=com.sleepycat.je.tree.IN lastFullLsn=0xffffffff/0xffffffff lastLoggedLsn=0xffffffff/0xffffffff parent.getDirty()=false state=0 expires=never SortedLSNTreeWalker failed dbId=35 isOffHeapBinInTree=false isLnInOffHeapBin=false deltaObject=false residentNode=false LOG_FILE_NOT_FOUND: Log file missing, log is likely invalid. Environment is invalid and must be closed. fetchLN of 0x1768/0x5e6ebee parent IN=5439570 IN class=com.sleepycat.je.tree.BIN lastFullLsn=0x3eaf/0x34404f4 lastLoggedLsn=0x3ec5/0x1efc6e7 parent.getDirty()=false state=0 expires=never Exiting
com.sleepycat.je.EnvironmentFailureException: (JE 18.3.12) Environment must be closed, caused by: com.sleepycat.je.EnvironmentFailureException: Environment invalid because of previous exception: (JE 18.3.12) /opendj/db/userRoot fetchIN of 0x340/0x48e9d8 parent IN=5277169 IN class=com.sleepycat.je.tree.IN lastFullLsn=0xffffffff/0xffffffff lastLoggedLsn=0xffffffff/0xffffffff parent.getDirty()=false state=0 expires=never SortedLSNTreeWalker failed dbId=35 isOffHeapBinInTree=false isLnInOffHeapBin=false deltaObject=false residentNode=false LOG_FILE_NOT_FOUND: Log file missing, log is likely invalid. Environment is invalid and must be closed. fetchLN of 0x1768/0x5e6ebee parent IN=5439570 IN class=com.sleepycat.je.tree.BIN lastFullLsn=0x3eaf/0x34404f4 lastLoggedLsn=0x3ec5/0x1efc6e7 parent.getDirty()=false state=0 expires=never
	at com.sleepycat.je.EnvironmentFailureException.wrapSelf(EnvironmentFailureException.java:230)
	at com.sleepycat.je.dbi.EnvironmentImpl.checkIfInvalid(EnvironmentImpl.java:1835)
	at com.sleepycat.je.log.LogManager.getLogEntry(LogManager.java:845)
	at com.sleepycat.je.log.LogManager.getLogEntryAllowInvisibleAtRecovery(LogManager.java:816)
	at com.sleepycat.je.tree.IN.fetchLN(IN.java:2803)
	at com.sleepycat.je.tree.IN.fetchLN(IN.java:2743)
	at com.sleepycat.je.dbi.CursorImpl.getCurrent(CursorImpl.java:2272)
	at com.sleepycat.je.dbi.CursorImpl.lockAndGetCurrent(CursorImpl.java:2111)
	at com.sleepycat.je.dbi.CursorImpl.getNext(CursorImpl.java:2612)
	at com.sleepycat.je.cleaner.UtilizationProfile.getObsoleteDetailInternal(UtilizationProfile.java:764)
	at com.sleepycat.je.cleaner.UtilizationProfile.getObsoleteDetailPacked(UtilizationProfile.java:672)
	at com.sleepycat.je.cleaner.FileProcessor.processFile(FileProcessor.java:700)
	at com.sleepycat.je.cleaner.FileProcessor.doClean(FileProcessor.java:505)
	at com.sleepycat.je.cleaner.FileProcessor.onWakeup(FileProcessor.java:304)
	at com.sleepycat.je.utilint.DaemonThread.run(DaemonThread.java:154)
	at java.base/java.lang.Thread.run(Thread.java:1583)
Caused by: com.sleepycat.je.EnvironmentFailureException: Environment invalid because of previous exception: (JE 18.3.12) /opendj/db/userRoot fetchIN of 0x340/0x48e9d8 parent IN=5277169 IN class=com.sleepycat.je.tree.IN lastFullLsn=0xffffffff/0xffffffff lastLoggedLsn=0xffffffff/0xffffffff parent.getDirty()=false state=0 expires=never SortedLSNTreeWalker failed dbId=35 isOffHeapBinInTree=false isLnInOffHeapBin=false deltaObject=false residentNode=false LOG_FILE_NOT_FOUND: Log file missing, log is likely invalid. Environment is invalid and must be closed.
	at com.sleepycat.je.dbi.SortedLSNTreeWalker.fetchLSN(SortedLSNTreeWalker.java:985)
	at com.sleepycat.je.dbi.SortedLSNTreeWalker.fetchLSNHandleExceptions(SortedLSNTreeWalker.java:684)
	at com.sleepycat.je.dbi.SortedLSNTreeWalker.fetchAndProcessLSN(SortedLSNTreeWalker.java:643)
	at com.sleepycat.je.dbi.SortedLSNTreeWalker.processAccumulatedLSNs(SortedLSNTreeWalker.java:630)
	at com.sleepycat.je.dbi.SortedLSNTreeWalker.walkInternal(SortedLSNTreeWalker.java:356)
	at com.sleepycat.je.dbi.SortedLSNTreeWalker.walk(SortedLSNTreeWalker.java:331)
	at com.sleepycat.je.cleaner.ExtinctionScanner$DatabaseExtinction.run(ExtinctionScanner.java:1962)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
	... 1 more
Caused by: java.io.FileNotFoundException: /opendj/db/userRoot/00000340.jdb (No such file or directory)
	at java.base/java.io.RandomAccessFile.open0(Native Method)
	at java.base/java.io.RandomAccessFile.open(RandomAccessFile.java:356)
	at java.base/java.io.RandomAccessFile.<init>(RandomAccessFile.java:273)
	at java.base/java.io.RandomAccessFile.<init>(RandomAccessFile.java:223)
	at java.base/java.io.RandomAccessFile.<init>(RandomAccessFile.java:137)
	at com.sleepycat.je.log.FileManager$DefaultRandomAccessFile.<init>(FileManager.java:3369)
	at com.sleepycat.je.log.FileManager$6.createFile(FileManager.java:3397)
	at com.sleepycat.je.log.FileManager.openFileHandle(FileManager.java:1427)
	at com.sleepycat.je.log.FileManager.getFileHandle(FileManager.java:1298)
	at com.sleepycat.je.log.LogManager.getLogSource(LogManager.java:1210)
	at com.sleepycat.je.log.LogManager.getLogEntry(LogManager.java:856)
	at com.sleepycat.je.log.LogManager.getWholeLogEntry(LogManager.java:806)
	at com.sleepycat.je.dbi.SortedLSNTreeWalker.fetchLSN(SortedLSNTreeWalker.java:967)
	... 9 more

[12/Feb/2026:14:19:21 -0500] category=PROTOCOL severity=NOTICE msgID=276 msg=Started listening for new connections on LDAP Connection Handler 0.0.0.0 port 1389
[12/Feb/2026:14:19:21 -0500] category=CORE severity=NOTICE msgID=135 msg=The Directory Server has started successfully
[12/Feb/2026:14:19:21 -0500] category=CORE severity=NOTICE msgID=139 msg=The Directory Server has sent an alert notification generated by class org.opends.server.core.DirectoryServer (alert type org.opends.server.DirectoryServerStarted, alert ID org.opends.messages.core-135): The Directory Server has started successfully
Exception in thread "main" java.lang.VerifyError: Bad type on operand stack
Exception Details:
  Location:
    org/forgerock/opendj/rest2ldap/Resource.build(Lorg/forgerock/opendj/rest2ldap/Rest2Ldap;)V @129: invokevirtual
  Reason:
    Type 'org/forgerock/json/resource/Router' (current frame, stack[1]) is not assignable to 'org/forgerock/services/routing/AbstractRouter'
  Current Frame:
    bci: @129
    flags: { }
    locals: { 'org/forgerock/opendj/rest2ldap/Resource', 'org/forgerock/opendj/rest2ldap/Rest2Ldap' }
    stack: { 'org/forgerock/json/resource/Router', 'org/forgerock/json/resource/Router' }
  Bytecode:
    0000000: 2ab4 000e 9900 04b1 2a04 b500 0e2a b400
    0000010: 1fc6 0084 2a2b 2ab4 001f b600 55b5 0056
    0000020: 2ab4 0056 c700 19bb 0057 59b2 0058 2ab4
    0000030: 001a 2ab4 001f b600 3eb7 0059 bf2a b400
    0000040: 562b b600 5a2a b400 56b4 000f 2ab9 002a
    0000050: 0200 572a b400 26c7 000e 2a2a b400 56b4
    0000060: 0026 b500 262a b400 062a b400 56b4 0006
    0000070: b900 5b02 0057 2ab4 0015 2ab4 0056 b400
    0000080: 15b6 005c 572a b400 0d2a b400 56b4 000d
    0000090: b900 5d02 002a b400 0d2a b400 0cb9 005d
    00000a0: 0200 2ab4 000d b900 5e01 00b9 002f 0100
    00000b0: 4d2c b900 3001 0099 002a 2cb9 0031 0100
    00000c0: c000 5f4e 2ab4 0012 2db9 0060 0100 c000
    00000d0: 612d b900 6201 00c0 0063 b600 6457 a7ff
    00000e0: d32a b400 09b9 002f 0100 4d2c b900 3001
    00000f0: 0099 0022 2cb9 0031 0100 c000 534e 2d2b
    0000100: 2ab4 001a b600 652d 2ab4 0015 b600 6657
    0000110: a7ff dbb1                              
  Stackmap Table:
    same_frame(@8)
    same_frame(@61)
    same_frame(@101)
    same_frame(@149)
    append_frame(@177,Object[#451])
    chop_frame(@225,1)
    append_frame(@235,Object[#451])
    chop_frame(@275,1)

	at org.forgerock.opendj.rest2ldap.Rest2Ldap.resource(Rest2Ldap.java:172)
	at org.opends.server.protocols.http.rest2ldap.AdminEndpoint$AdminHttpApplication.startRequestHandler(AdminEndpoint.java:149)
	at org.opends.server.protocols.http.rest2ldap.AdminEndpoint$AdminHttpApplication.start(AdminEndpoint.java:140)
	at org.opends.server.core.HttpEndpointConfigManager.applyConfigurationAdd(HttpEndpointConfigManager.java:163)
	at org.opends.server.core.HttpEndpointConfigManager.registerTo(HttpEndpointConfigManager.java:124)
	at org.opends.server.core.DirectoryServer.startServer(DirectoryServer.java:1549)
	at org.opends.server.core.DirectoryServer.main(DirectoryServer.java:5054)
[12/Feb/2026:14:19:21 -0500] category=PROTOCOL severity=NOTICE msgID=276 msg=Started listening for new connections on Administration Connector 0.0.0.0 port 5444

[vharseko]

Then it's easier through export/import

[chrisgolle]

ah, but alas, if I try and replicate this to bring it in sync with an online server I think I will have new problems. i might try deleting all the indices from the server before backing up since it seems like thats where it failed on the upgrade and then recreate indices after. my goal is to upgrade opendj without downtime in a replicated environment.

[chrisgolle]

small update. attempted removing all indices and restoring to no avail.
the upgrade does however work on a much smaller version of my db, so something to do with the contents or size of the data appears to be preventing it from working. with debug logging on, i havent noticed any glaring reasons why.