Re: Error from re-start on very large context file

From: Parviz Fariborz (parviz_fariborz_at_mentor_dot_com)
Date: Tue Jun 10 2008 - 06:12:32 PDT

  • Next message: Paul H. Hargrove: "Re: Error from re-start on very large context file"
    Hi Paul,
    
    Attached is the output of the dmesg command after I built blcr with the 
    debug flag. It is longer than 100 lines, but I thought the extra data 
    may be helpful.
    
    One point that I have observed: As expected, for successful re-start, 
    the pid of the re-started process matches that of the check-pointed 
    process. This has not been the case for my failed re-starts, the pids do 
    not match. I am not sure if this is significant.
    
    Please let me know if I can be of any assistance.
    
    -Parviz
    
    
    
    Paul H. Hargrove wrote:
    > Parviz,
    >
    >   The problem you describe does not sound like any know bug or 
    > limitation in BLCR.  It is likely that you have uncovered a new BLCR bug.
    >   The "Bad Address" (from the -14) is EFAULT, which suggests that some 
    > aspect of the restarted memory mapping is incorrect.  If there is any 
    > failure to allocate/map memory, then the vmadump portion of BLCR 
    > should be detecting the failure prior to causing an EFAULT by 
    > accessing the memory.
    >   It would help if you could reconfigure and build BLCR with 
    > "--enable-debug" passed to BLCR's configure script to enable detailed 
    > tracing.  If you load the modules by running "make insmod 
    > cr_ktrace_mask=0xffffffff" in you BLCR build directory, then the next 
    > time you try to restart from your 36G context file dmesg should 
    > provide some detail as to what was happening prior to the EFAULT. 
    >  Sending us the last 100 lines or so from dmesg should probably be 
    > sufficient for us to narrow the possible causes, and perhaps suggest a 
    > solution.
    >
    > -Paul
    >
    > Parviz Fariborz wrote:
    >>
    >> Hi,
    >>
    >> I get the following error when I re-start a context file produced by 
    >> blcr-0.7.0 :
    >>
    >> => cr_restart context.21849
    >> Restart failed: Bad address
    >>
    >> The dmesg command produces the following error :
    >>
    >> blcr: Retry request on -CR_ENOSUPPORT
    >> blcr: thaw_threads returned error, aborting. -14
    >>
    >> Any idea what I may be doing wrong? Is this a bug?
    >>
    >> Several more pieces of info :
    >>
    >> I run blcr on a 64 bit machine running linux red-hat :
    >>
    >> =>uname -a
    >> Linux ivel6 2.6.9-67.ELsmp #1 SMP Wed Nov 7 13:56:44 EST 2007 x86_64 
    >> x86_64 x86_64 GNU/Linux
    >>
    >> Th size of the context file that produces the error is very large, 
    >> around 36G. When a checkpoint the same executable with an smaller 
    >> data set, which produce a smaller context file (around 3G) re-start 
    >> works with no problem.
    >>
    >> Thanks in advance for your help.
    >> -Parviz
    >>
    >
    >
    
    
    req.c:254>, pid 17045: Alloc cr_chkpt_req_t 0000010174b64040
    ctrl_open <cr_fops.c:225>, pid 17045: entering 
    cr_loc_init <cr_dest_file.c:158>, pid 17045: Calling do_init_reg on fd 4
    add_proc <cr_chkpt_req.c:562>, pid 17045: Add proc pid=17045
    add_task <cr_chkpt_req.c:436>, pid 17045: entering task=00000105df46f030 (17045)
    do_trigger <cr_trigger.c:94>, pid 17045: triggered pid 17045 (lt-forward) w/ retval=0
    ctrl_ioctl <cr_fops.c:127>, pid 17045: entering op=4008a113 arg=0x7fbfffd500
    cr_chkpt_fwd <cr_chkpt_req.c:999>, pid 17045: entering 
    cr_log_request <cr_chkpt_req.c:834>, pid 17045: forwarding to process tree 17045
    build_req_tree <cr_chkpt_req.c:707>, pid 17045: in build_req_tree
    add_proc <cr_chkpt_req.c:562>, pid 17045: Add proc pid=17045
    add_task <cr_chkpt_req.c:436>, pid 17045: entering task=00000105df46f030 (17045)
    add_task <cr_chkpt_req.c:494>, pid 17045: Confirmed duplicate task 17045
    build_req_tree <cr_chkpt_req.c:722>, pid 17045: scanning children
    build_req_tree <cr_chkpt_req.c:728>, pid 17045: found child 17045
    add_task <cr_chkpt_req.c:436>, pid 17045: entering task=000001037bf2d7f0 (17059)
    add_task <cr_chkpt_req.c:502>, pid 17045: Request overlap when checkpointing task 17059
    cr_chkpt_fwd <cr_chkpt_req.c:1055>, pid 17045: cleaning up task: 17045
    ctrl_ioctl <cr_fops.c:127>, pid 17045: entering op=4008a101 arg=0x0
    cr_dump_self <cr_dump_self.c:999>, pid 17045: entering flags=0x0
    cr_dump_self <cr_dump_self.c:1019>, pid 17045: NOTIFY(&req->preshared_barrier) returning 1
    cr_save_file_header <cr_dump_self.c:697>, pid 17045: Dumping file header
    cr_signal_predump_barrier <cr_chkpt_req.c:1151>, pid 17045: ENTER(&proc_req->predump_barrier)
    cr_signal_predump_barrier <cr_chkpt_req.c:1151>, pid 17045: LEAVE(&proc_req->predump_barrier) returning 1
    cr_do_vmadump <cr_dump_self.c:777>, pid 17045: Preparing to dump 1 threads of lt-forward
    cr_save_header <cr_dump_self.c:725>, pid 17045: Dumping header for 1 threads
    cr_do_vmadump <cr_dump_self.c:786>, pid 17045: Writing the per-process linkage.
    cr_do_vmadump <cr_dump_self.c:813>, pid 17045: Writing credentials
    cr_do_vmadump <cr_dump_self.c:854>, pid 17045: Writing vmadump.
    cr_do_vmadump <cr_dump_self.c:865>, pid 17045: thread finished vmadump
    cr_do_vmadump <cr_dump_self.c:870>, pid 17045: ENTER(&proc_req->vmadump_barrier)
    cr_do_vmadump <cr_dump_self.c:870>, pid 17045: LEAVE(&proc_req->vmadump_barrier) returning 1
    cr_do_vmadump <cr_dump_self.c:871>, pid 17045: process finished vmadump
    cr_do_vmadump <cr_dump_self.c:877>, pid 17045: Writing the fs struct...
    cr_do_vmadump <cr_dump_self.c:885>, pid 17045: Writing the mmap()s table (if any)...
    cr_do_vmadump <cr_dump_self.c:894>, pid 17045: Writing POSIX interval timers...
    cr_do_vmadump <cr_dump_self.c:915>, pid 17045: Writing the open file section...
    cr_save_all_files <cr_dump_self.c:556>, pid 17045: entering 
    cr_save_all_files <cr_dump_self.c:559>, pid 17045:     ...files_struct
    cr_save_all_files <cr_dump_self.c:567>, pid 17045:     ...files
    cr_save_all_files <cr_dump_self.c:634>, pid 17045:     ...0 is open character device.
    cr_save_all_files <cr_dump_self.c:642>, pid 17045:     ...1 is dup of 000001065b4f6380
    cr_save_all_files <cr_dump_self.c:642>, pid 17045:     ...2 is dup of 000001065b4f6380
    cr_save_all_files <cr_dump_self.c:614>, pid 17045:     ...3 is regular file.
    cr_save_all_files <cr_dump_self.c:583>, pid 17045: fd 4 is the context file - skipping
    cr_save_all_files <cr_dump_self.c:626>, pid 17045:     ...5 is open fifo.
    cr_fifo_is_internal <cr_pipes.c:657>, pid 17045: leaving Return 'external'
    cr_save_all_files <cr_dump_self.c:626>, pid 17045:     ...6 is open fifo.
    cr_fifo_is_internal <cr_pipes.c:657>, pid 17045: leaving Return 'external'
    cr_save_all_files <cr_dump_self.c:646>, pid 17045:     ...7 is a checkpoint request.
    cr_do_vmadump <cr_dump_self.c:923>, pid 17045: Writing mmap()ed pages (if any)...
    cr_dump_self <cr_dump_self.c:1114>, pid 17045: ENTER(&req->postdump_barrier)
    cr_dump_self <cr_dump_self.c:1114>, pid 17045: LEAVE(&req->postdump_barrier) returning 1
    cr_dump_self <cr_dump_self.c:1119>, pid 17045: Writing the trailer.
    cr_save_header <cr_dump_self.c:725>, pid 17045: Dumping header for 0 threads
    cr_dump_self <cr_dump_self.c:1151>, pid 17045: leaving Returning 0
    ctrl_ioctl <cr_fops.c:127>, pid 17045: entering op=4008a108 arg=0xffffffffffffffff
    cr_hand_complete <cr_fops.c:42>, pid 17045: entering 
    cr_signal_chkpt_complete_barrier <cr_chkpt_req.c:1182>, pid 17045: ENTER(&proc_req->pre_complete_barrier)
    cr_signal_chkpt_complete_barrier <cr_chkpt_req.c:1182>, pid 17045: LEAVE(&proc_req->pre_complete_barrier) returning 1
    cr_chkpt_task_complete <cr_chkpt_req.c:1310>, pid 17045: ENTER(&proc_req->post_complete_barrier)
    cr_chkpt_task_complete <cr_chkpt_req.c:1310>, pid 17045: LEAVE(&proc_req->post_complete_barrier) returning 1
    cr_hand_complete <cr_fops.c:66>, pid 17045: leaving Returning 0
    ctrl_ioctl <cr_fops.c:127>, pid 17045: entering op=c008a111 arg=0x0
    cr_chkpt_done <cr_chkpt_req.c:1387>, pid 17045: entering 
    cr_chkpt_done <cr_chkpt_req.c:1428>, pid 17045: leaving Returning 1
    ctrl_ioctl <cr_fops.c:127>, pid 17045: entering op=0000a112 arg=0xffffffffffffffff
    ctrl_release <cr_fops.c:240>, pid 17045: entering 
    release_request <cr_chkpt_req.c:52>, pid 17045: Free cr_chkpt_req_t 0000010174b64040
    ctrl_release <cr_fops.c:240>, pid 17045: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17059: entering op=4008a101 arg=0x0
    cr_dump_self <cr_dump_self.c:999>, pid 17059: entering flags=0x0
    cr_dump_self <cr_dump_self.c:1019>, pid 17059: NOTIFY(&req->preshared_barrier) returning 1
    cr_save_file_header <cr_dump_self.c:697>, pid 17059: Dumping file header
    cr_signal_predump_barrier <cr_chkpt_req.c:1151>, pid 17059: ENTER(&proc_req->predump_barrier)
    cr_signal_predump_barrier <cr_chkpt_req.c:1151>, pid 17059: LEAVE(&proc_req->predump_barrier) returning 1
    cr_do_vmadump <cr_dump_self.c:777>, pid 17059: Preparing to dump 1 threads of lt-forward
    cr_save_header <cr_dump_self.c:725>, pid 17059: Dumping header for 1 threads
    cr_do_vmadump <cr_dump_self.c:786>, pid 17059: Writing the per-process linkage.
    cr_do_vmadump <cr_dump_self.c:813>, pid 17059: Writing credentials
    cr_do_vmadump <cr_dump_self.c:854>, pid 17059: Writing vmadump.
    cr_do_vmadump <cr_dump_self.c:865>, pid 17059: thread finished vmadump
    cr_do_vmadump <cr_dump_self.c:870>, pid 17059: ENTER(&proc_req->vmadump_barrier)
    cr_do_vmadump <cr_dump_self.c:870>, pid 17059: LEAVE(&proc_req->vmadump_barrier) returning 1
    cr_do_vmadump <cr_dump_self.c:871>, pid 17059: process finished vmadump
    cr_do_vmadump <cr_dump_self.c:877>, pid 17059: Writing the fs struct...
    cr_do_vmadump <cr_dump_self.c:885>, pid 17059: Writing the mmap()s table (if any)...
    cr_do_vmadump <cr_dump_self.c:894>, pid 17059: Writing POSIX interval timers...
    cr_do_vmadump <cr_dump_self.c:915>, pid 17059: Writing the open file section...
    cr_save_all_files <cr_dump_self.c:556>, pid 17059: entering 
    cr_save_all_files <cr_dump_self.c:559>, pid 17059:     ...files_struct
    cr_save_all_files <cr_dump_self.c:567>, pid 17059:     ...files
    cr_save_all_files <cr_dump_self.c:634>, pid 17059:     ...0 is open character device.
    cr_save_all_files <cr_dump_self.c:642>, pid 17059:     ...1 is dup of 000001065b4f6380
    cr_save_all_files <cr_dump_self.c:642>, pid 17059:     ...2 is dup of 000001065b4f6380
    cr_save_all_files <cr_dump_self.c:614>, pid 17059:     ...3 is regular file.
    cr_save_all_files <cr_dump_self.c:626>, pid 17059:     ...4 is open fifo.
    cr_fifo_is_internal <cr_pipes.c:657>, pid 17059: leaving Return 'external'
    cr_save_all_files <cr_dump_self.c:583>, pid 17059: fd 5 is the context file - skipping
    cr_save_all_files <cr_dump_self.c:646>, pid 17059:     ...6 is a checkpoint request.
    cr_save_all_files <cr_dump_self.c:626>, pid 17059:     ...7 is open fifo.
    cr_fifo_is_internal <cr_pipes.c:657>, pid 17059: leaving Return 'external'
    cr_do_vmadump <cr_dump_self.c:923>, pid 17059: Writing mmap()ed pages (if any)...
    cr_dump_self <cr_dump_self.c:1114>, pid 17059: ENTER(&req->postdump_barrier)
    cr_dump_self <cr_dump_self.c:1114>, pid 17059: LEAVE(&req->postdump_barrier) returning 1
    cr_dump_self <cr_dump_self.c:1119>, pid 17059: Writing the trailer.
    cr_save_header <cr_dump_self.c:725>, pid 17059: Dumping header for 0 threads
    cr_dump_self <cr_dump_self.c:1151>, pid 17059: leaving Returning 0
    ctrl_ioctl <cr_fops.c:127>, pid 17059: entering op=4008a108 arg=0xffffffffffffffff
    cr_hand_complete <cr_fops.c:42>, pid 17059: entering 
    cr_signal_chkpt_complete_barrier <cr_chkpt_req.c:1182>, pid 17059: ENTER(&proc_req->pre_complete_barrier)
    cr_signal_chkpt_complete_barrier <cr_chkpt_req.c:1182>, pid 17059: LEAVE(&proc_req->pre_complete_barrier) returning 1
    cr_chkpt_task_complete <cr_chkpt_req.c:1310>, pid 17059: ENTER(&proc_req->post_complete_barrier)
    cr_chkpt_task_complete <cr_chkpt_req.c:1310>, pid 17059: LEAVE(&proc_req->post_complete_barrier) returning 1
    cr_hand_complete <cr_fops.c:66>, pid 17059: leaving Returning 0
    ctrl_release <cr_fops.c:240>, pid 17059: entering 
    ctrl_release <cr_fops.c:240>, pid 17045: entering 
    __cr_task_put <cr_task.c:126>, pid 17045: Free cr_task_t 00000102a44cecd0
    __cr_task_put <cr_task.c:126>, pid 17045: Free cr_task_t 00000102f26399c8
    ctrl_open <cr_fops.c:225>, pid 17060: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17060: entering op=4008a130 arg=0x8
    ctrl_ioctl <cr_fops.c:127>, pid 17060: entering op=4008a107 arg=0x3
    cr_phase2_register <cr_sync.c:73>, pid 17060: entering 
    __cr_task_get <cr_task.c:98>, pid 17060: Alloc cr_task_t 00000102a44cec28 for pid 17060
    ctrl_ioctl <cr_fops.c:127>, pid 17082: entering op=4008a105 arg=0x3
    cr_phase1_register <cr_async.c:145>, pid 17082: entering 
    __cr_task_get <cr_task.c:98>, pid 17082: Alloc cr_task_t 00000102a44cee20 for pid 17082
    ctrl_ioctl <cr_fops.c:127>, pid 17082: entering op=c008a106 arg=0x0
    cr_suspend <cr_async.c:79>, pid 17082: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17060: entering op=4008a120 arg=0x7fbffff210
    cr_rstrt_request_restart <cr_rstrt_req.c:765>, pid 17060: entering 
    alloc_rstrt_req <cr_rstrt_req.c:71>, pid 17060: Alloc cr_rstrt_req_t 000001043e2d0e80
    cr_loc_init <cr_dest_file.c:158>, pid 17060: Calling do_init_reg on fd 4
    cr_rstrt_request_restart <cr_rstrt_req.c:826>, pid 17060: cr_magic = 67 82, cr_version = 7, scope = 0, arch = 5.
    ctrl_ioctl <cr_fops.c:127>, pid 17060: entering op=8008a126 arg=0x7fbfffec50
    cr_rstrt_procs <cr_rstrt_req.c:876>, pid 17060: entering 
    cr_rstrt_procs <cr_rstrt_req.c:1000>, pid 17060: leaving Returning 1
    ctrl_ioctl <cr_fops.c:127>, pid 17083: entering op=0000a123 arg=0xffffffffffffffff
    cr_rstrt_child <cr_rstrt_req.c:2478>, pid 17083: entering 
    __cr_task_get <cr_task.c:98>, pid 17083: Alloc cr_task_t 00000102f26399c8 for pid 17083
    cr_rstrt_child <cr_rstrt_req.c:2518>, pid 17083: NOTIFY(&proc_req->vmadump_barrier) returning 1
    cr_reserve_ids <cr_rstrt_req.c:501>, pid 17083: Now reserving required ids... 
    cr_reserve_ids <cr_rstrt_req.c:501>, pid 17083: Now reserving required ids... 
    cr_rstrt_child <cr_rstrt_req.c:2586>, pid 17083: 17083: Restoring credentials
    ctrl_ioctl <cr_fops.c:127>, pid 17060: entering op=8008a126 arg=0x7fbfffec50
    cr_rstrt_procs <cr_rstrt_req.c:876>, pid 17060: entering 
    cr_rstrt_child <cr_rstrt_req.c:2659>, pid 17083: Formerly lt-forward PID 17045
    cr_restore_pids <cr_rstrt_req.c:1363>, pid 17083: Now restoring the pids... 
    cr_restore_pids <cr_rstrt_req.c:1370>, pid 17045: Linkage restore finished...
    cr_restore_pids <cr_rstrt_req.c:1379>, pid 17045: ENTER_INTERRUPTIBLE(&proc_req->linkage_barrier)
    cr_restore_pids <cr_rstrt_req.c:1379>, pid 17045: LEAVE(&proc_req->linkage_barrier) returning 1
    cr_rstrt_child <cr_rstrt_req.c:2707>, pid 17045: 17045: loading mmap()s table
    cr_rstrt_child <cr_rstrt_req.c:2720>, pid 17045: Reading POSIX interval timers...
    cr_restore_all_files <cr_rstrt_req.c:2017>, pid 17045: close-on-exec of callers files
    cr_restore_all_files <cr_rstrt_req.c:2031>, pid 17045: recovering fs_struct...
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17045: entering 
    cr_restore_all_files <cr_rstrt_req.c:2062>, pid 17045:    fd=0 dnr=1
    cr_restore_open_chr <cr_rstrt_req.c:1752>, pid 17045: entering 
    cr_restore_open_chr <cr_rstrt_req.c:1809>, pid 17045:    Character device.  major=5, minor=0 path='/dev/tty'
    cr_restore_file_locks <cr_rstrt_req.c:1969>, pid 17045: entering 
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17045: entering 
    cr_restore_all_files <cr_rstrt_req.c:2062>, pid 17045:    fd=1 dnr=1
    cr_restore_open_dup <cr_rstrt_req.c:1886>, pid 17045: entering 
    cr_restore_open_dup <cr_rstrt_req.c:1912>, pid 17045: cr_dup2(000001065b4f6380 -> 1) successful
    cr_restore_file_locks <cr_rstrt_req.c:1969>, pid 17045: entering 
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17045: entering 
    cr_restore_all_files <cr_rstrt_req.c:2062>, pid 17045:    fd=2 dnr=1
    cr_restore_open_dup <cr_rstrt_req.c:1886>, pid 17045: entering 
    cr_restore_open_dup <cr_rstrt_req.c:1912>, pid 17045: cr_dup2(000001065b4f6380 -> 2) successful
    cr_restore_file_locks <cr_rstrt_req.c:1969>, pid 17045: entering 
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17045: entering 
    cr_restore_all_files <cr_rstrt_req.c:2062>, pid 17045:    fd=3 dnr=0
    cr_restore_open_file <cr_rstrt_req.c:1548>, pid 17045: entering 
    ctrl_open <cr_fops.c:225>, pid 17045: entering 
    cr_restore_file_locks <cr_rstrt_req.c:1969>, pid 17045: entering 
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17045: entering 
    cr_restore_all_files <cr_rstrt_req.c:2062>, pid 17045:    fd=5 dnr=0
    cr_restore_open_fifo <cr_pipes.c:490>, pid 17045: entering 
    cr_restore_open_fifo <cr_pipes.c:499>, pid 17045:    Open fifo: id == 00000106681456e0.
    cr_couple_fifo <cr_pipes.c:397>, pid 17045: pipe:[3649139]:  phase 2: connecting second end.
    cr_restore_file_locks <cr_rstrt_req.c:1969>, pid 17045: entering 
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17045: entering 
    cr_restore_all_files <cr_rstrt_req.c:2062>, pid 17045:    fd=6 dnr=0
    cr_restore_open_fifo <cr_pipes.c:490>, pid 17045: entering 
    cr_restore_open_fifo <cr_pipes.c:499>, pid 17045:    Open fifo: id == 00000106676a76e0.
    cr_couple_fifo <cr_pipes.c:397>, pid 17045: pipe:[3649140]:  phase 2: connecting second end.
    cr_restore_file_locks <cr_rstrt_req.c:1969>, pid 17045: entering 
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17045: entering 
    cr_restore_all_files <cr_rstrt_req.c:2062>, pid 17045:    fd=7 dnr=0
    cr_restore_open_chkpt_req <cr_rstrt_req.c:1927>, pid 17045: entering 
    cr_restore_open_file <cr_rstrt_req.c:1548>, pid 17045: entering 
    ctrl_open <cr_fops.c:225>, pid 17045: entering 
    cr_restore_file_locks <cr_rstrt_req.c:1969>, pid 17045: entering 
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17045: entering 
    cr_end_of_file_restore <cr_rstrt_req.c:1957>, pid 17045: entering 
    cr_finish_all_file_restores <cr_rstrt_req.c:1982>, pid 17045: entering 
    cr_finish_all_file_restores <cr_rstrt_req.c:1985>, pid 17045: current->files=00000102d17961c0
    cr_finish_all_file_restores <cr_rstrt_req.c:1990>, pid 17045: fd=0 filp=000001065b4f6380 filp->dentry=0000010113566268 d_count=4 d_inode=0000010666433d88
    cr_finish_all_file_restores <cr_rstrt_req.c:1990>, pid 17045: fd=1 filp=000001065b4f6380 filp->dentry=0000010113566268 d_count=4 d_inode=0000010666433d88
    cr_finish_all_file_restores <cr_rstrt_req.c:1990>, pid 17045: fd=2 filp=000001065b4f6380 filp->dentry=0000010113566268 d_count=4 d_inode=0000010666433d88
    cr_finish_all_file_restores <cr_rstrt_req.c:1990>, pid 17045: fd=3 filp=000001065bb05e80 filp->dentry=00000106681d59a8 d_count=4 d_inode=0000010397f5e7a0
    cr_finish_all_file_restores <cr_rstrt_req.c:1990>, pid 17045: fd=5 filp=000001063211b280 filp->dentry=0000010113566268 d_count=4 d_inode=0000010666433d88
    cr_finish_all_file_restores <cr_rstrt_req.c:1990>, pid 17045: fd=6 filp=000001065bb05380 filp->dentry=0000010113566268 d_count=4 d_inode=0000010666433d88
    cr_finish_all_file_restores <cr_rstrt_req.c:1990>, pid 17045: fd=7 filp=0000010530d022c0 filp->dentry=00000106681d59a8 d_count=4 d_inode=0000010397f5e7a0
    cr_rstrt_child <cr_rstrt_req.c:2759>, pid 17045: 17045: closing request descriptor
    cr_rstrt_child <cr_rstrt_req.c:2770>, pid 17045: 17045: closing context file descriptor
    cr_rstrt_child <cr_rstrt_req.c:2826>, pid 17045: NOTIFY(&req->barrier) returning 0
    cr_restore_parents <cr_rstrt_req.c:676>, pid 17060: Now restoring the parent linkage... 
    cr_rstrt_procs <cr_rstrt_req.c:997>, pid 17060: NOTIFY(&req->barrier) returning 1
    cr_rstrt_procs <cr_rstrt_req.c:1000>, pid 17060: leaving Returning 0
    ctrl_ioctl <cr_fops.c:127>, pid 17060: entering op=c008a121 arg=0x0
    cr_rstrt_done <cr_rstrt_req.c:1052>, pid 17060: entering 
    cr_rstrt_child <cr_rstrt_req.c:2846>, pid 17045: leaving Returning 17060
    ctrl_ioctl <cr_fops.c:127>, pid 17045: entering op=4008a108 arg=0xffffffffffffffff
    cr_hand_complete <cr_fops.c:42>, pid 17045: entering 
    cr_signal_rstrt_complete_barrier <cr_rstrt_req.c:2282>, pid 17045: ENTER(&proc_req->pre_complete_barrier)
    cr_signal_rstrt_complete_barrier <cr_rstrt_req.c:2282>, pid 17045: LEAVE(&proc_req->pre_complete_barrier) returning 1
    cr_rstrt_task_complete <cr_rstrt_req.c:2447>, pid 17045: ENTER(&proc_req->post_complete_barrier)
    cr_rstrt_task_complete <cr_rstrt_req.c:2447>, pid 17045: LEAVE(&proc_req->post_complete_barrier) returning 1
    release_rstrt_req <cr_rstrt_req.c:107>, pid 17045: ref count is approximately 3
    cr_hand_complete <cr_fops.c:66>, pid 17045: leaving Returning 0
    release_rstrt_req <cr_rstrt_req.c:107>, pid 17060: ref count is approximately 2
    cr_rstrt_done <cr_rstrt_req.c:1091>, pid 17060: leaving Returning 1
    ctrl_ioctl <cr_fops.c:127>, pid 17060: entering op=0000a122 arg=0xffffffffffffffff
    cr_rstrt_reap <cr_rstrt_req.c:1109>, pid 17060: entering 
    release_rstrt_req <cr_rstrt_req.c:107>, pid 17060: ref count is approximately 1
    release_rstrt_req <cr_rstrt_req.c:127>, pid 17060: Releasing source file
    release_rstrt_req <cr_rstrt_req.c:130>, pid 17060: fput()'ing stdin/out
    release_rstrt_req <cr_rstrt_req.c:133>, pid 17060: put_task_struct(cr_restart_task)
    release_rstrt_req <cr_rstrt_req.c:139>, pid 17060: Free cr_rstrt_req_t 000001043e2d0e80
    cr_rstrt_reap <cr_rstrt_req.c:1125>, pid 17060: leaving Returning 17045
    ctrl_ioctl <cr_fops.c:127>, pid 17045: entering op=c008a111 arg=0x0
    cr_chkpt_done <cr_chkpt_req.c:1387>, pid 17045: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17045: entering op=0000a112 arg=0xffffffffffffffff
    ctrl_release <cr_fops.c:240>, pid 17045: entering 
    ctrl_release <cr_fops.c:240>, pid 17045: entering 
    __cr_task_put <cr_task.c:126>, pid 17045: Free cr_task_t 00000102f26399c8
    cr_suspend <cr_async.c:117>, pid 17082: leaving with pending signal
    ctrl_release <cr_fops.c:240>, pid 17082: entering 
    __cr_task_put <cr_task.c:126>, pid 17082: Free cr_task_t 00000102a44cee20
    __cr_task_put <cr_task.c:126>, pid 17082: Free cr_task_t 00000102a44cec28
    ctrl_open <cr_fops.c:225>, pid 17100: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17100: entering op=4008a130 arg=0x8
    ctrl_ioctl <cr_fops.c:127>, pid 17100: entering op=4008a107 arg=0x3
    cr_phase2_register <cr_sync.c:73>, pid 17100: entering 
    __cr_task_get <cr_task.c:98>, pid 17100: Alloc cr_task_t 00000102f26399c8 for pid 17100
    ctrl_open <cr_fops.c:225>, pid 17100: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17100: entering op=4008a130 arg=0x8
    ctrl_ioctl <cr_fops.c:127>, pid 17100: entering op=4008a110 arg=0x7fbfffe790
    cr_chkpt_req <cr_chkpt_req.c:856>, pid 17100: entering 
    cr_log_request <cr_chkpt_req.c:834>, pid 17100: checkpointing its own process 17100
    cr_chkpt_req <cr_chkpt_req.c:878>, pid 17100:  checkpoint params:  secs= 0, opts=0000000000000000, fd=4
    alloc_request <cr_chkpt_req.c:254>, pid 17100: Alloc cr_chkpt_req_t 0000010174b64040
    ctrl_open <cr_fops.c:225>, pid 17100: entering 
    cr_loc_init <cr_dest_file.c:158>, pid 17100: Calling do_init_reg on fd 4
    add_proc <cr_chkpt_req.c:562>, pid 17100: Add proc pid=17100
    add_task <cr_chkpt_req.c:436>, pid 17100: entering task=0000010295bea030 (17100)
    do_trigger <cr_trigger.c:94>, pid 17100: triggered pid 17100 (lt-hooks) w/ retval=0
    ctrl_ioctl <cr_fops.c:127>, pid 17100: entering op=4008a101 arg=0x0
    cr_dump_self <cr_dump_self.c:999>, pid 17100: entering flags=0x0
    cr_dump_self <cr_dump_self.c:1019>, pid 17100: NOTIFY(&req->preshared_barrier) returning 1
    cr_save_file_header <cr_dump_self.c:697>, pid 17100: Dumping file header
    cr_signal_predump_barrier <cr_chkpt_req.c:1151>, pid 17100: ENTER(&proc_req->predump_barrier)
    cr_signal_predump_barrier <cr_chkpt_req.c:1151>, pid 17100: LEAVE(&proc_req->predump_barrier) returning 1
    cr_do_vmadump <cr_dump_self.c:777>, pid 17100: Preparing to dump 1 threads of lt-hooks
    cr_save_header <cr_dump_self.c:725>, pid 17100: Dumping header for 1 threads
    cr_do_vmadump <cr_dump_self.c:786>, pid 17100: Writing the per-process linkage.
    cr_do_vmadump <cr_dump_self.c:813>, pid 17100: Writing credentials
    cr_do_vmadump <cr_dump_self.c:854>, pid 17100: Writing vmadump.
    cr_do_vmadump <cr_dump_self.c:865>, pid 17100: thread finished vmadump
    cr_do_vmadump <cr_dump_self.c:870>, pid 17100: ENTER(&proc_req->vmadump_barrier)
    cr_do_vmadump <cr_dump_self.c:870>, pid 17100: LEAVE(&proc_req->vmadump_barrier) returning 1
    cr_do_vmadump <cr_dump_self.c:871>, pid 17100: process finished vmadump
    cr_do_vmadump <cr_dump_self.c:877>, pid 17100: Writing the fs struct...
    cr_do_vmadump <cr_dump_self.c:885>, pid 17100: Writing the mmap()s table (if any)...
    cr_do_vmadump <cr_dump_self.c:894>, pid 17100: Writing POSIX interval timers...
    cr_do_vmadump <cr_dump_self.c:915>, pid 17100: Writing the open file section...
    cr_save_all_files <cr_dump_self.c:556>, pid 17100: entering 
    cr_save_all_files <cr_dump_self.c:559>, pid 17100:     ...files_struct
    cr_save_all_files <cr_dump_self.c:567>, pid 17100:     ...files
    cr_save_all_files <cr_dump_self.c:634>, pid 17100:     ...0 is open character device.
    cr_save_all_files <cr_dump_self.c:642>, pid 17100:     ...1 is dup of 000001065b4f6380
    cr_save_all_files <cr_dump_self.c:642>, pid 17100:     ...2 is dup of 000001065b4f6380
    cr_save_all_files <cr_dump_self.c:614>, pid 17100:     ...3 is regular file.
    cr_save_all_files <cr_dump_self.c:583>, pid 17100: fd 4 is the context file - skipping
    cr_save_all_files <cr_dump_self.c:646>, pid 17100:     ...5 is a checkpoint request.
    cr_do_vmadump <cr_dump_self.c:923>, pid 17100: Writing mmap()ed pages (if any)...
    cr_dump_self <cr_dump_self.c:1114>, pid 17100: ENTER(&req->postdump_barrier)
    cr_dump_self <cr_dump_self.c:1114>, pid 17100: LEAVE(&req->postdump_barrier) returning 1
    cr_dump_self <cr_dump_self.c:1119>, pid 17100: Writing the trailer.
    cr_save_header <cr_dump_self.c:725>, pid 17100: Dumping header for 0 threads
    cr_dump_self <cr_dump_self.c:1151>, pid 17100: leaving Returning 0
    ctrl_ioctl <cr_fops.c:127>, pid 17100: entering op=4008a108 arg=0xffffffffffffffff
    cr_hand_complete <cr_fops.c:42>, pid 17100: entering 
    cr_signal_chkpt_complete_barrier <cr_chkpt_req.c:1182>, pid 17100: ENTER(&proc_req->pre_complete_barrier)
    cr_signal_chkpt_complete_barrier <cr_chkpt_req.c:1182>, pid 17100: LEAVE(&proc_req->pre_complete_barrier) returning 1
    cr_chkpt_task_complete <cr_chkpt_req.c:1310>, pid 17100: ENTER(&proc_req->post_complete_barrier)
    cr_chkpt_task_complete <cr_chkpt_req.c:1310>, pid 17100: LEAVE(&proc_req->post_complete_barrier) returning 1
    cr_hand_complete <cr_fops.c:66>, pid 17100: leaving Returning 0
    ctrl_ioctl <cr_fops.c:127>, pid 17100: entering op=c008a111 arg=0x0
    cr_chkpt_done <cr_chkpt_req.c:1387>, pid 17100: entering 
    cr_chkpt_done <cr_chkpt_req.c:1428>, pid 17100: leaving Returning 1
    ctrl_ioctl <cr_fops.c:127>, pid 17100: entering op=0000a112 arg=0xffffffffffffffff
    ctrl_release <cr_fops.c:240>, pid 17100: entering 
    release_request <cr_chkpt_req.c:52>, pid 17100: Free cr_chkpt_req_t 0000010174b64040
    ctrl_release <cr_fops.c:240>, pid 17100: entering 
    ctrl_release <cr_fops.c:240>, pid 17100: entering 
    __cr_task_put <cr_task.c:126>, pid 17100: Free cr_task_t 00000102f26399c8
    ctrl_open <cr_fops.c:225>, pid 17113: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17113: entering op=4008a130 arg=0x8
    ctrl_ioctl <cr_fops.c:127>, pid 17113: entering op=4008a107 arg=0x3
    cr_phase2_register <cr_sync.c:73>, pid 17113: entering 
    __cr_task_get <cr_task.c:98>, pid 17113: Alloc cr_task_t 00000102f26399c8 for pid 17113
    ctrl_ioctl <cr_fops.c:127>, pid 17135: entering op=4008a105 arg=0x3
    cr_phase1_register <cr_async.c:145>, pid 17135: entering 
    __cr_task_get <cr_task.c:98>, pid 17135: Alloc cr_task_t 00000102a44cecd0 for pid 17135
    ctrl_ioctl <cr_fops.c:127>, pid 17135: entering op=c008a106 arg=0x0
    cr_suspend <cr_async.c:79>, pid 17135: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17113: entering op=4008a120 arg=0x7fbffff210
    cr_rstrt_request_restart <cr_rstrt_req.c:765>, pid 17113: entering 
    alloc_rstrt_req <cr_rstrt_req.c:71>, pid 17113: Alloc cr_rstrt_req_t 000001043e2d0e80
    cr_loc_init <cr_dest_file.c:158>, pid 17113: Calling do_init_reg on fd 4
    cr_rstrt_request_restart <cr_rstrt_req.c:826>, pid 17113: cr_magic = 67 82, cr_version = 7, scope = 0, arch = 5.
    ctrl_ioctl <cr_fops.c:127>, pid 17113: entering op=8008a126 arg=0x7fbfffec50
    cr_rstrt_procs <cr_rstrt_req.c:876>, pid 17113: entering 
    cr_rstrt_procs <cr_rstrt_req.c:1000>, pid 17113: leaving Returning 1
    ctrl_ioctl <cr_fops.c:127>, pid 17136: entering op=0000a123 arg=0xffffffffffffffff
    cr_rstrt_child <cr_rstrt_req.c:2478>, pid 17136: entering 
    __cr_task_get <cr_task.c:98>, pid 17136: Alloc cr_task_t 00000102f2639140 for pid 17136
    cr_rstrt_child <cr_rstrt_req.c:2518>, pid 17136: NOTIFY(&proc_req->vmadump_barrier) returning 1
    cr_reserve_ids <cr_rstrt_req.c:501>, pid 17136: Now reserving required ids... 
    cr_reserve_ids <cr_rstrt_req.c:501>, pid 17136: Now reserving required ids... 
    cr_rstrt_child <cr_rstrt_req.c:2586>, pid 17136: 17136: Restoring credentials
    ctrl_ioctl <cr_fops.c:127>, pid 17113: entering op=8008a126 arg=0x7fbfffec50
    cr_rstrt_procs <cr_rstrt_req.c:876>, pid 17113: entering 
    cr_rstrt_child <cr_rstrt_req.c:2659>, pid 17136: Formerly lt-hooks PID 17100
    cr_restore_pids <cr_rstrt_req.c:1363>, pid 17136: Now restoring the pids... 
    cr_restore_pids <cr_rstrt_req.c:1370>, pid 17100: Linkage restore finished...
    cr_restore_pids <cr_rstrt_req.c:1379>, pid 17100: ENTER_INTERRUPTIBLE(&proc_req->linkage_barrier)
    cr_restore_pids <cr_rstrt_req.c:1379>, pid 17100: LEAVE(&proc_req->linkage_barrier) returning 1
    cr_rstrt_child <cr_rstrt_req.c:2707>, pid 17100: 17100: loading mmap()s table
    cr_rstrt_child <cr_rstrt_req.c:2720>, pid 17100: Reading POSIX interval timers...
    cr_restore_all_files <cr_rstrt_req.c:2017>, pid 17100: close-on-exec of callers files
    cr_restore_all_files <cr_rstrt_req.c:2031>, pid 17100: recovering fs_struct...
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17100: entering 
    cr_restore_all_files <cr_rstrt_req.c:2062>, pid 17100:    fd=0 dnr=1
    cr_restore_open_chr <cr_rstrt_req.c:1752>, pid 17100: entering 
    cr_restore_open_chr <cr_rstrt_req.c:1809>, pid 17100:    Character device.  major=5, minor=0 path='/dev/tty'
    cr_restore_file_locks <cr_rstrt_req.c:1969>, pid 17100: entering 
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17100: entering 
    cr_restore_all_files <cr_rstrt_req.c:2062>, pid 17100:    fd=1 dnr=1
    cr_restore_open_dup <cr_rstrt_req.c:1886>, pid 17100: entering 
    cr_restore_open_dup <cr_rstrt_req.c:1912>, pid 17100: cr_dup2(000001065b4f6380 -> 1) successful
    cr_restore_file_locks <cr_rstrt_req.c:1969>, pid 17100: entering 
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17100: entering 
    cr_restore_all_files <cr_rstrt_req.c:2062>, pid 17100:    fd=2 dnr=1
    cr_restore_open_dup <cr_rstrt_req.c:1886>, pid 17100: entering 
    cr_restore_open_dup <cr_rstrt_req.c:1912>, pid 17100: cr_dup2(000001065b4f6380 -> 2) successful
    cr_restore_file_locks <cr_rstrt_req.c:1969>, pid 17100: entering 
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17100: entering 
    cr_restore_all_files <cr_rstrt_req.c:2062>, pid 17100:    fd=3 dnr=0
    cr_restore_open_file <cr_rstrt_req.c:1548>, pid 17100: entering 
    ctrl_open <cr_fops.c:225>, pid 17100: entering 
    cr_restore_file_locks <cr_rstrt_req.c:1969>, pid 17100: entering 
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17100: entering 
    cr_restore_all_files <cr_rstrt_req.c:2062>, pid 17100:    fd=5 dnr=0
    cr_restore_open_chkpt_req <cr_rstrt_req.c:1927>, pid 17100: entering 
    cr_restore_open_file <cr_rstrt_req.c:1548>, pid 17100: entering 
    ctrl_open <cr_fops.c:225>, pid 17100: entering 
    cr_restore_file_locks <cr_rstrt_req.c:1969>, pid 17100: entering 
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17100: entering 
    cr_end_of_file_restore <cr_rstrt_req.c:1957>, pid 17100: entering 
    cr_finish_all_file_restores <cr_rstrt_req.c:1982>, pid 17100: entering 
    cr_finish_all_file_restores <cr_rstrt_req.c:1985>, pid 17100: current->files=0000010667e351c0
    cr_finish_all_file_restores <cr_rstrt_req.c:1990>, pid 17100: fd=0 filp=000001065b4f6380 filp->dentry=0000010113566268 d_count=2 d_inode=0000010666433d88
    cr_finish_all_file_restores <cr_rstrt_req.c:1990>, pid 17100: fd=1 filp=000001065b4f6380 filp->dentry=0000010113566268 d_count=2 d_inode=0000010666433d88
    cr_finish_all_file_restores <cr_rstrt_req.c:1990>, pid 17100: fd=2 filp=000001065b4f6380 filp->dentry=0000010113566268 d_count=2 d_inode=0000010666433d88
    cr_finish_all_file_restores <cr_rstrt_req.c:1990>, pid 17100: fd=3 filp=000001065dad8780 filp->dentry=00000106681d59a8 d_count=4 d_inode=0000010397f5e7a0
    cr_finish_all_file_restores <cr_rstrt_req.c:1990>, pid 17100: fd=5 filp=000001004142e680 filp->dentry=00000106681d59a8 d_count=4 d_inode=0000010397f5e7a0
    cr_rstrt_child <cr_rstrt_req.c:2759>, pid 17100: 17100: closing request descriptor
    cr_rstrt_child <cr_rstrt_req.c:2770>, pid 17100: 17100: closing context file descriptor
    cr_rstrt_child <cr_rstrt_req.c:2826>, pid 17100: NOTIFY(&req->barrier) returning 0
    cr_restore_parents <cr_rstrt_req.c:676>, pid 17113: Now restoring the parent linkage... 
    cr_rstrt_procs <cr_rstrt_req.c:997>, pid 17113: NOTIFY(&req->barrier) returning 1
    cr_rstrt_procs <cr_rstrt_req.c:1000>, pid 17113: leaving Returning 0
    ctrl_ioctl <cr_fops.c:127>, pid 17113: entering op=c008a121 arg=0x0
    cr_rstrt_done <cr_rstrt_req.c:1052>, pid 17113: entering 
    cr_rstrt_child <cr_rstrt_req.c:2846>, pid 17100: leaving Returning 17113
    ctrl_ioctl <cr_fops.c:127>, pid 17100: entering op=4008a108 arg=0xffffffffffffffff
    cr_hand_complete <cr_fops.c:42>, pid 17100: entering 
    cr_signal_rstrt_complete_barrier <cr_rstrt_req.c:2282>, pid 17100: ENTER(&proc_req->pre_complete_barrier)
    cr_signal_rstrt_complete_barrier <cr_rstrt_req.c:2282>, pid 17100: LEAVE(&proc_req->pre_complete_barrier) returning 1
    cr_rstrt_task_complete <cr_rstrt_req.c:2447>, pid 17100: ENTER(&proc_req->post_complete_barrier)
    cr_rstrt_task_complete <cr_rstrt_req.c:2447>, pid 17100: LEAVE(&proc_req->post_complete_barrier) returning 1
    release_rstrt_req <cr_rstrt_req.c:107>, pid 17100: ref count is approximately 3
    cr_hand_complete <cr_fops.c:66>, pid 17100: leaving Returning 0
    release_rstrt_req <cr_rstrt_req.c:107>, pid 17113: ref count is approximately 2
    cr_rstrt_done <cr_rstrt_req.c:1091>, pid 17113: leaving Returning 1
    ctrl_ioctl <cr_fops.c:127>, pid 17113: entering op=0000a122 arg=0xffffffffffffffff
    cr_rstrt_reap <cr_rstrt_req.c:1109>, pid 17113: entering 
    release_rstrt_req <cr_rstrt_req.c:107>, pid 17113: ref count is approximately 1
    release_rstrt_req <cr_rstrt_req.c:127>, pid 17113: Releasing source file
    release_rstrt_req <cr_rstrt_req.c:130>, pid 17113: fput()'ing stdin/out
    release_rstrt_req <cr_rstrt_req.c:133>, pid 17113: put_task_struct(cr_restart_task)
    release_rstrt_req <cr_rstrt_req.c:139>, pid 17113: Free cr_rstrt_req_t 000001043e2d0e80
    cr_rstrt_reap <cr_rstrt_req.c:1125>, pid 17113: leaving Returning 17100
    ctrl_ioctl <cr_fops.c:127>, pid 17100: entering op=c008a111 arg=0x0
    cr_chkpt_done <cr_chkpt_req.c:1387>, pid 17100: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17100: entering op=0000a112 arg=0xffffffffffffffff
    ctrl_release <cr_fops.c:240>, pid 17100: entering 
    ctrl_release <cr_fops.c:240>, pid 17100: entering 
    __cr_task_put <cr_task.c:126>, pid 17100: Free cr_task_t 00000102f2639140
    cr_suspend <cr_async.c:117>, pid 17135: leaving with pending signal
    ctrl_release <cr_fops.c:240>, pid 17135: entering 
    __cr_task_put <cr_task.c:126>, pid 17135: Free cr_task_t 00000102a44cecd0
    __cr_task_put <cr_task.c:126>, pid 17135: Free cr_task_t 00000102f26399c8
    ctrl_open <cr_fops.c:225>, pid 17137: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17137: entering op=4008a130 arg=0x8
    ctrl_ioctl <cr_fops.c:127>, pid 17137: entering op=4008a107 arg=0x3
    cr_phase2_register <cr_sync.c:73>, pid 17137: entering 
    __cr_task_get <cr_task.c:98>, pid 17137: Alloc cr_task_t 00000102f26399c8 for pid 17137
    ctrl_ioctl <cr_fops.c:127>, pid 17150: entering op=4008a105 arg=0x3
    cr_phase1_register <cr_async.c:145>, pid 17150: entering 
    __cr_task_get <cr_task.c:98>, pid 17150: Alloc cr_task_t 00000102a44cecd0 for pid 17150
    ctrl_ioctl <cr_fops.c:127>, pid 17150: entering op=c008a106 arg=0x0
    cr_suspend <cr_async.c:79>, pid 17150: entering 
    ctrl_open <cr_fops.c:225>, pid 17137: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17137: entering op=4008a130 arg=0x8
    ctrl_ioctl <cr_fops.c:127>, pid 17137: entering op=4008a110 arg=0x7fbfffe790
    cr_chkpt_req <cr_chkpt_req.c:856>, pid 17137: entering 
    cr_log_request <cr_chkpt_req.c:834>, pid 17137: checkpointing its own process 17137
    cr_chkpt_req <cr_chkpt_req.c:878>, pid 17137:  checkpoint params:  secs= 0, opts=0000000000000000, fd=4
    alloc_request <cr_chkpt_req.c:254>, pid 17137: Alloc cr_chkpt_req_t 0000010174b64040
    ctrl_open <cr_fops.c:225>, pid 17137: entering 
    cr_loc_init <cr_dest_file.c:158>, pid 17137: Calling do_init_reg on fd 4
    add_proc <cr_chkpt_req.c:562>, pid 17137: Add proc pid=17137
    add_task <cr_chkpt_req.c:436>, pid 17137: entering task=0000010295bea030 (17137)
    add_task <cr_chkpt_req.c:436>, pid 17137: entering task=00000104c06a9030 (17150)
    do_trigger <cr_trigger.c:94>, pid 17137: triggered pid 17150 (lt-hooks) w/ retval=0
    ctrl_ioctl <cr_fops.c:127>, pid 17137: entering op=c008a111 arg=0x0
    cr_chkpt_done <cr_chkpt_req.c:1387>, pid 17137: entering 
    cr_suspend <cr_async.c:119>, pid 17150: leaving with pending checkpoint
    ctrl_ioctl <cr_fops.c:127>, pid 17150: entering op=4008a101 arg=0x0
    cr_dump_self <cr_dump_self.c:999>, pid 17150: entering flags=0x0
    cr_dump_self <cr_dump_self.c:1019>, pid 17150: NOTIFY(&req->preshared_barrier) returning 0
    cr_save_file_header <cr_dump_self.c:697>, pid 17150: Dumping file header
    cr_signal_phase_barrier <cr_chkpt_req.c:1127>, pid 17150: NOTIFY(&proc_req->phase_barrier) returning 1
    do_trigger <cr_trigger.c:94>, pid 17150: triggered pid 17137 (lt-hooks) w/ retval=0
    cr_signal_predump_barrier <cr_chkpt_req.c:1151>, pid 17150: ENTER(&proc_req->predump_barrier)
    cr_chkpt_done <cr_chkpt_req.c:1428>, pid 17137: leaving Returning -4
    ctrl_ioctl <cr_fops.c:127>, pid 17137: entering op=4008a101 arg=0x0
    cr_dump_self <cr_dump_self.c:999>, pid 17137: entering flags=0x0
    cr_dump_self <cr_dump_self.c:1019>, pid 17137: NOTIFY(&req->preshared_barrier) returning 1
    cr_signal_predump_barrier <cr_chkpt_req.c:1151>, pid 17137: ENTER(&proc_req->predump_barrier)
    cr_signal_predump_barrier <cr_chkpt_req.c:1151>, pid 17137: LEAVE(&proc_req->predump_barrier) returning 1
    cr_do_vmadump <cr_dump_self.c:777>, pid 17137: Preparing to dump 2 threads of lt-hooks
    cr_save_header <cr_dump_self.c:725>, pid 17137: Dumping header for 2 threads
    cr_do_vmadump <cr_dump_self.c:786>, pid 17137: Writing the per-process linkage.
    cr_do_vmadump <cr_dump_self.c:813>, pid 17137: Writing credentials
    cr_do_vmadump <cr_dump_self.c:854>, pid 17137: Writing vmadump.
    cr_do_vmadump <cr_dump_self.c:865>, pid 17137: thread finished vmadump
    cr_do_vmadump <cr_dump_self.c:870>, pid 17137: ENTER(&proc_req->vmadump_barrier)
    cr_signal_predump_barrier <cr_chkpt_req.c:1151>, pid 17150: LEAVE(&proc_req->predump_barrier) returning 0
    cr_do_vmadump <cr_dump_self.c:854>, pid 17150: Writing vmadump.
    cr_do_vmadump <cr_dump_self.c:865>, pid 17150: thread finished vmadump
    cr_do_vmadump <cr_dump_self.c:870>, pid 17150: ENTER(&proc_req->vmadump_barrier)
    cr_do_vmadump <cr_dump_self.c:870>, pid 17150: LEAVE(&proc_req->vmadump_barrier) returning 1
    cr_do_vmadump <cr_dump_self.c:871>, pid 17150: process finished vmadump
    cr_do_vmadump <cr_dump_self.c:877>, pid 17150: Writing the fs struct...
    cr_do_vmadump <cr_dump_self.c:870>, pid 17137: LEAVE(&proc_req->vmadump_barrier) returning 0
    cr_do_vmadump <cr_dump_self.c:885>, pid 17150: Writing the mmap()s table (if any)...
    cr_do_vmadump <cr_dump_self.c:894>, pid 17150: Writing POSIX interval timers...
    cr_do_vmadump <cr_dump_self.c:915>, pid 17150: Writing the open file section...
    cr_save_all_files <cr_dump_self.c:556>, pid 17150: entering 
    cr_save_all_files <cr_dump_self.c:559>, pid 17150:     ...files_struct
    cr_save_all_files <cr_dump_self.c:567>, pid 17150:     ...files
    cr_save_all_files <cr_dump_self.c:634>, pid 17150:     ...0 is open character device.
    cr_save_all_files <cr_dump_self.c:642>, pid 17150:     ...1 is dup of 000001065b4f6380
    cr_save_all_files <cr_dump_self.c:642>, pid 17150:     ...2 is dup of 000001065b4f6380
    cr_save_all_files <cr_dump_self.c:614>, pid 17150:     ...3 is regular file.
    cr_save_all_files <cr_dump_self.c:583>, pid 17150: fd 4 is the context file - skipping
    cr_save_all_files <cr_dump_self.c:646>, pid 17150:     ...5 is a checkpoint request.
    cr_do_vmadump <cr_dump_self.c:923>, pid 17150: Writing mmap()ed pages (if any)...
    cr_dump_self <cr_dump_self.c:1114>, pid 17150: ENTER(&req->postdump_barrier)
    cr_dump_self <cr_dump_self.c:1114>, pid 17137: ENTER(&req->postdump_barrier)
    cr_dump_self <cr_dump_self.c:1114>, pid 17137: LEAVE(&req->postdump_barrier) returning 1
    cr_dump_self <cr_dump_self.c:1119>, pid 17137: Writing the trailer.
    cr_save_header <cr_dump_self.c:725>, pid 17137: Dumping header for 0 threads
    cr_dump_self <cr_dump_self.c:1151>, pid 17137: leaving Returning 0
    ctrl_ioctl <cr_fops.c:127>, pid 17137: entering op=4008a108 arg=0xffffffffffffffff
    cr_hand_complete <cr_fops.c:42>, pid 17137: entering 
    cr_signal_chkpt_complete_barrier <cr_chkpt_req.c:1182>, pid 17137: ENTER(&proc_req->pre_complete_barrier)
    cr_dump_self <cr_dump_self.c:1114>, pid 17150: LEAVE(&req->postdump_barrier) returning 0
    cr_dump_self <cr_dump_self.c:1151>, pid 17150: leaving Returning 0
    ctrl_ioctl <cr_fops.c:127>, pid 17150: entering op=4008a108 arg=0xffffffffffffffff
    cr_hand_complete <cr_fops.c:42>, pid 17150: entering 
    cr_signal_chkpt_complete_barrier <cr_chkpt_req.c:1182>, pid 17150: ENTER(&proc_req->pre_complete_barrier)
    cr_signal_chkpt_complete_barrier <cr_chkpt_req.c:1182>, pid 17150: LEAVE(&proc_req->pre_complete_barrier) returning 1
    cr_chkpt_task_complete <cr_chkpt_req.c:1310>, pid 17150: ENTER(&proc_req->post_complete_barrier)
    cr_signal_chkpt_complete_barrier <cr_chkpt_req.c:1182>, pid 17137: LEAVE(&proc_req->pre_complete_barrier) returning 0
    cr_chkpt_task_complete <cr_chkpt_req.c:1310>, pid 17137: ENTER(&proc_req->post_complete_barrier)
    cr_chkpt_task_complete <cr_chkpt_req.c:1310>, pid 17137: LEAVE(&proc_req->post_complete_barrier) returning 1
    cr_hand_complete <cr_fops.c:66>, pid 17137: leaving Returning 0
    ctrl_ioctl <cr_fops.c:127>, pid 17137: entering op=c008a111 arg=0x0
    cr_chkpt_done <cr_chkpt_req.c:1387>, pid 17137: entering 
    cr_chkpt_task_complete <cr_chkpt_req.c:1310>, pid 17150: LEAVE(&proc_req->post_complete_barrier) returning 0
    cr_hand_complete <cr_fops.c:66>, pid 17150: leaving Returning 0
    cr_chkpt_done <cr_chkpt_req.c:1428>, pid 17137: leaving Returning 1
    ctrl_ioctl <cr_fops.c:127>, pid 17137: entering op=0000a112 arg=0xffffffffffffffff
    ctrl_release <cr_fops.c:240>, pid 17137: entering 
    release_request <cr_chkpt_req.c:52>, pid 17137: Free cr_chkpt_req_t 0000010174b64040
    ctrl_release <cr_fops.c:240>, pid 17137: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17150: entering op=c008a106 arg=0x0
    cr_suspend <cr_async.c:79>, pid 17150: entering 
    cr_suspend <cr_async.c:117>, pid 17150: leaving with pending signal
    ctrl_release <cr_fops.c:240>, pid 17150: entering 
    __cr_task_put <cr_task.c:126>, pid 17150: Free cr_task_t 00000102a44cecd0
    __cr_task_put <cr_task.c:126>, pid 17150: Free cr_task_t 00000102f26399c8
    ctrl_open <cr_fops.c:225>, pid 17151: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17151: entering op=4008a130 arg=0x8
    ctrl_ioctl <cr_fops.c:127>, pid 17151: entering op=4008a107 arg=0x3
    cr_phase2_register <cr_sync.c:73>, pid 17151: entering 
    __cr_task_get <cr_task.c:98>, pid 17151: Alloc cr_task_t 00000102f26399c8 for pid 17151
    ctrl_ioctl <cr_fops.c:127>, pid 17173: entering op=4008a105 arg=0x3
    cr_phase1_register <cr_async.c:145>, pid 17173: entering 
    __cr_task_get <cr_task.c:98>, pid 17173: Alloc cr_task_t 00000102a44cecd0 for pid 17173
    ctrl_ioctl <cr_fops.c:127>, pid 17173: entering op=c008a106 arg=0x0
    cr_suspend <cr_async.c:79>, pid 17173: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17151: entering op=4008a120 arg=0x7fbffff210
    cr_rstrt_request_restart <cr_rstrt_req.c:765>, pid 17151: entering 
    alloc_rstrt_req <cr_rstrt_req.c:71>, pid 17151: Alloc cr_rstrt_req_t 000001043e2d0e80
    cr_loc_init <cr_dest_file.c:158>, pid 17151: Calling do_init_reg on fd 4
    cr_rstrt_request_restart <cr_rstrt_req.c:826>, pid 17151: cr_magic = 67 82, cr_version = 7, scope = 0, arch = 5.
    ctrl_ioctl <cr_fops.c:127>, pid 17151: entering op=8008a126 arg=0x7fbfffec50
    cr_rstrt_procs <cr_rstrt_req.c:876>, pid 17151: entering 
    cr_rstrt_procs <cr_rstrt_req.c:1000>, pid 17151: leaving Returning 1
    ctrl_ioctl <cr_fops.c:127>, pid 17174: entering op=0000a123 arg=0xffffffffffffffff
    cr_rstrt_child <cr_rstrt_req.c:2478>, pid 17174: entering 
    __cr_task_get <cr_task.c:98>, pid 17174: Alloc cr_task_t 00000102f2639140 for pid 17174
    cr_rstrt_child <cr_rstrt_req.c:2518>, pid 17174: NOTIFY(&proc_req->vmadump_barrier) returning 0
    cr_reserve_ids <cr_rstrt_req.c:501>, pid 17174: Now reserving required ids... 
    cr_reserve_ids <cr_rstrt_req.c:501>, pid 17174: Now reserving required ids... 
    cr_rstrt_child <cr_rstrt_req.c:2586>, pid 17174: 17174: Restoring credentials
    ctrl_ioctl <cr_fops.c:127>, pid 17151: entering op=8008a126 arg=0x7fbfffec50
    cr_rstrt_procs <cr_rstrt_req.c:876>, pid 17151: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17175: entering op=0000a123 arg=0xffffffffffffffff
    cr_rstrt_child <cr_rstrt_req.c:2478>, pid 17175: entering 
    __cr_task_get <cr_task.c:98>, pid 17175: Alloc cr_task_t 00000102a44ced78 for pid 17175
    cr_rstrt_child <cr_rstrt_req.c:2518>, pid 17175: NOTIFY(&proc_req->vmadump_barrier) returning 1
    cr_rstrt_child <cr_rstrt_req.c:2659>, pid 17174: Formerly lt-hooks PID 17137
    cr_restore_pids <cr_rstrt_req.c:1379>, pid 17174: ENTER_INTERRUPTIBLE(&proc_req->linkage_barrier)
    cr_rstrt_child <cr_rstrt_req.c:2659>, pid 17175: Formerly lt-hooks PID 17150
    cr_restore_pids <cr_rstrt_req.c:1363>, pid 17175: Now restoring the pids... 
    cr_restore_pids <cr_rstrt_req.c:1370>, pid 17150: Linkage restore finished...
    cr_restore_pids <cr_rstrt_req.c:1379>, pid 17150: ENTER_INTERRUPTIBLE(&proc_req->linkage_barrier)
    cr_restore_pids <cr_rstrt_req.c:1379>, pid 17150: LEAVE(&proc_req->linkage_barrier) returning 1
    cr_restore_pids <cr_rstrt_req.c:1379>, pid 17137: LEAVE(&proc_req->linkage_barrier) returning 0
    cr_rstrt_child <cr_rstrt_req.c:2707>, pid 17150: 17150: loading mmap()s table
    cr_rstrt_child <cr_rstrt_req.c:2720>, pid 17150: Reading POSIX interval timers...
    cr_restore_all_files <cr_rstrt_req.c:2017>, pid 17150: close-on-exec of callers files
    cr_restore_all_files <cr_rstrt_req.c:2031>, pid 17150: recovering fs_struct...
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17150: entering 
    cr_restore_all_files <cr_rstrt_req.c:2062>, pid 17150:    fd=0 dnr=1
    cr_restore_open_chr <cr_rstrt_req.c:1752>, pid 17150: entering 
    cr_restore_open_chr <cr_rstrt_req.c:1809>, pid 17150:    Character device.  major=5, minor=0 path='/dev/tty'
    cr_restore_file_locks <cr_rstrt_req.c:1969>, pid 17150: entering 
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17150: entering 
    cr_restore_all_files <cr_rstrt_req.c:2062>, pid 17150:    fd=1 dnr=1
    cr_restore_open_dup <cr_rstrt_req.c:1886>, pid 17150: entering 
    cr_restore_open_dup <cr_rstrt_req.c:1912>, pid 17150: cr_dup2(000001065b4f6380 -> 1) successful
    cr_restore_file_locks <cr_rstrt_req.c:1969>, pid 17150: entering 
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17150: entering 
    cr_restore_all_files <cr_rstrt_req.c:2062>, pid 17150:    fd=2 dnr=1
    cr_restore_open_dup <cr_rstrt_req.c:1886>, pid 17150: entering 
    cr_restore_open_dup <cr_rstrt_req.c:1912>, pid 17150: cr_dup2(000001065b4f6380 -> 2) successful
    cr_restore_file_locks <cr_rstrt_req.c:1969>, pid 17150: entering 
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17150: entering 
    cr_restore_all_files <cr_rstrt_req.c:2062>, pid 17150:    fd=3 dnr=0
    cr_restore_open_file <cr_rstrt_req.c:1548>, pid 17150: entering 
    ctrl_open <cr_fops.c:225>, pid 17150: entering 
    cr_restore_file_locks <cr_rstrt_req.c:1969>, pid 17150: entering 
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17150: entering 
    cr_restore_all_files <cr_rstrt_req.c:2062>, pid 17150:    fd=5 dnr=0
    cr_restore_open_chkpt_req <cr_rstrt_req.c:1927>, pid 17150: entering 
    cr_restore_open_file <cr_rstrt_req.c:1548>, pid 17150: entering 
    ctrl_open <cr_fops.c:225>, pid 17150: entering 
    cr_restore_file_locks <cr_rstrt_req.c:1969>, pid 17150: entering 
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17150: entering 
    cr_end_of_file_restore <cr_rstrt_req.c:1957>, pid 17150: entering 
    cr_finish_all_file_restores <cr_rstrt_req.c:1982>, pid 17150: entering 
    cr_finish_all_file_restores <cr_rstrt_req.c:1985>, pid 17150: current->files=0000010415269780
    cr_finish_all_file_restores <cr_rstrt_req.c:1990>, pid 17150: fd=0 filp=000001065b4f6380 filp->dentry=0000010113566268 d_count=2 d_inode=0000010666433d88
    cr_finish_all_file_restores <cr_rstrt_req.c:1990>, pid 17150: fd=1 filp=000001065b4f6380 filp->dentry=0000010113566268 d_count=2 d_inode=0000010666433d88
    cr_finish_all_file_restores <cr_rstrt_req.c:1990>, pid 17150: fd=2 filp=000001065b4f6380 filp->dentry=0000010113566268 d_count=2 d_inode=0000010666433d88
    cr_finish_all_file_restores <cr_rstrt_req.c:1990>, pid 17150: fd=3 filp=00000101193470c0 filp->dentry=00000106681d59a8 d_count=4 d_inode=0000010397f5e7a0
    cr_finish_all_file_restores <cr_rstrt_req.c:1990>, pid 17150: fd=5 filp=00000101e6ac5180 filp->dentry=00000106681d59a8 d_count=4 d_inode=0000010397f5e7a0
    cr_rstrt_child <cr_rstrt_req.c:2759>, pid 17150: 17150: closing request descriptor
    cr_rstrt_child <cr_rstrt_req.c:2770>, pid 17150: 17150: closing context file descriptor
    cr_rstrt_child <cr_rstrt_req.c:2826>, pid 17150: NOTIFY(&req->barrier) returning 0
    cr_rstrt_child <cr_rstrt_req.c:2826>, pid 17137: NOTIFY(&req->barrier) returning 0
    cr_restore_parents <cr_rstrt_req.c:676>, pid 17151: Now restoring the parent linkage... 
    cr_rstrt_procs <cr_rstrt_req.c:997>, pid 17151: NOTIFY(&req->barrier) returning 1
    cr_rstrt_procs <cr_rstrt_req.c:1000>, pid 17151: leaving Returning 0
    ctrl_ioctl <cr_fops.c:127>, pid 17151: entering op=c008a121 arg=0x0
    cr_rstrt_done <cr_rstrt_req.c:1052>, pid 17151: entering 
    cr_rstrt_child <cr_rstrt_req.c:2846>, pid 17137: leaving Returning 17151
    ctrl_ioctl <cr_fops.c:127>, pid 17137: entering op=4008a108 arg=0xffffffffffffffff
    cr_hand_complete <cr_fops.c:42>, pid 17137: entering 
    cr_signal_rstrt_complete_barrier <cr_rstrt_req.c:2282>, pid 17137: ENTER(&proc_req->pre_complete_barrier)
    cr_rstrt_child <cr_rstrt_req.c:2846>, pid 17150: leaving Returning 17151
    ctrl_ioctl <cr_fops.c:127>, pid 17150: entering op=4008a108 arg=0xffffffffffffffff
    cr_hand_complete <cr_fops.c:42>, pid 17150: entering 
    cr_signal_rstrt_complete_barrier <cr_rstrt_req.c:2282>, pid 17150: ENTER(&proc_req->pre_complete_barrier)
    cr_signal_rstrt_complete_barrier <cr_rstrt_req.c:2282>, pid 17150: LEAVE(&proc_req->pre_complete_barrier) returning 1
    cr_rstrt_task_complete <cr_rstrt_req.c:2447>, pid 17150: ENTER(&proc_req->post_complete_barrier)
    cr_signal_rstrt_complete_barrier <cr_rstrt_req.c:2282>, pid 17137: LEAVE(&proc_req->pre_complete_barrier) returning 0
    cr_rstrt_task_complete <cr_rstrt_req.c:2447>, pid 17137: ENTER(&proc_req->post_complete_barrier)
    cr_rstrt_task_complete <cr_rstrt_req.c:2447>, pid 17137: LEAVE(&proc_req->post_complete_barrier) returning 1
    release_rstrt_req <cr_rstrt_req.c:107>, pid 17137: ref count is approximately 4
    cr_hand_complete <cr_fops.c:66>, pid 17137: leaving Returning 0
    ctrl_ioctl <cr_fops.c:127>, pid 17137: entering op=c008a111 arg=0x0
    cr_chkpt_done <cr_chkpt_req.c:1387>, pid 17137: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17137: entering op=0000a112 arg=0xffffffffffffffff
    ctrl_release <cr_fops.c:240>, pid 17137: entering 
    cr_rstrt_task_complete <cr_rstrt_req.c:2447>, pid 17150: LEAVE(&proc_req->post_complete_barrier) returning 0
    release_rstrt_req <cr_rstrt_req.c:107>, pid 17150: ref count is approximately 3
    cr_hand_complete <cr_fops.c:66>, pid 17150: leaving Returning 0
    release_rstrt_req <cr_rstrt_req.c:107>, pid 17151: ref count is approximately 2
    cr_rstrt_done <cr_rstrt_req.c:1091>, pid 17151: leaving Returning 1
    ctrl_ioctl <cr_fops.c:127>, pid 17151: entering op=0000a122 arg=0xffffffffffffffff
    cr_rstrt_reap <cr_rstrt_req.c:1109>, pid 17151: entering 
    release_rstrt_req <cr_rstrt_req.c:107>, pid 17151: ref count is approximately 1
    release_rstrt_req <cr_rstrt_req.c:127>, pid 17151: Releasing source file
    release_rstrt_req <cr_rstrt_req.c:130>, pid 17151: fput()'ing stdin/out
    release_rstrt_req <cr_rstrt_req.c:133>, pid 17151: put_task_struct(cr_restart_task)
    release_rstrt_req <cr_rstrt_req.c:139>, pid 17151: Free cr_rstrt_req_t 000001043e2d0e80
    cr_rstrt_reap <cr_rstrt_req.c:1125>, pid 17151: leaving Returning 17137
    ctrl_release <cr_fops.c:240>, pid 17150: entering 
    __cr_task_put <cr_task.c:126>, pid 17150: Free cr_task_t 00000102a44ced78
    __cr_task_put <cr_task.c:126>, pid 17150: Free cr_task_t 00000102f2639140
    cr_suspend <cr_async.c:117>, pid 17173: leaving with pending signal
    ctrl_release <cr_fops.c:240>, pid 17173: entering 
    __cr_task_put <cr_task.c:126>, pid 17173: Free cr_task_t 00000102a44cecd0
    __cr_task_put <cr_task.c:126>, pid 17173: Free cr_task_t 00000102f26399c8
    ctrl_open <cr_fops.c:225>, pid 17176: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17176: entering op=4008a130 arg=0x8
    ctrl_ioctl <cr_fops.c:127>, pid 17176: entering op=4008a107 arg=0x3
    cr_phase2_register <cr_sync.c:73>, pid 17176: entering 
    __cr_task_get <cr_task.c:98>, pid 17176: Alloc cr_task_t 00000102f26399c8 for pid 17176
    ctrl_open <cr_fops.c:225>, pid 17176: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17176: entering op=4008a130 arg=0x8
    ctrl_ioctl <cr_fops.c:127>, pid 17176: entering op=4008a110 arg=0x7fbfffe790
    cr_chkpt_req <cr_chkpt_req.c:856>, pid 17176: entering 
    cr_log_request <cr_chkpt_req.c:834>, pid 17176: checkpointing its own process 17176
    cr_chkpt_req <cr_chkpt_req.c:878>, pid 17176:  checkpoint params:  secs= 0, opts=0000000000000000, fd=4
    alloc_request <cr_chkpt_req.c:254>, pid 17176: Alloc cr_chkpt_req_t 0000010174b64040
    ctrl_open <cr_fops.c:225>, pid 17176: entering 
    cr_loc_init <cr_dest_file.c:158>, pid 17176: Calling do_init_reg on fd 4
    add_proc <cr_chkpt_req.c:562>, pid 17176: Add proc pid=17176
    add_task <cr_chkpt_req.c:436>, pid 17176: entering task=0000010295bea030 (17176)
    add_task <cr_chkpt_req.c:436>, pid 17176: entering task=00000104c06a9030 (17189)
    __cr_task_get <cr_task.c:98>, pid 17176: Alloc cr_task_t 00000102a44cecd0 for pid 17189
    do_trigger <cr_trigger.c:94>, pid 17176: triggered pid 17176 (lt-hooks) w/ retval=0
    do_trigger <cr_trigger.c:94>, pid 17176: triggered pid 17189 (lt-hooks) w/ retval=0
    ctrl_ioctl <cr_fops.c:127>, pid 17176: entering op=4008a101 arg=0x0
    cr_dump_self <cr_dump_self.c:999>, pid 17176: entering flags=0x0
    cr_dump_self <cr_dump_self.c:1019>, pid 17176: NOTIFY(&req->preshared_barrier) returning 0
    cr_save_file_header <cr_dump_self.c:697>, pid 17176: Dumping file header
    cr_signal_predump_barrier <cr_chkpt_req.c:1151>, pid 17176: ENTER(&proc_req->predump_barrier)
    ctrl_ioctl <cr_fops.c:127>, pid 17189: entering op=4008a101 arg=0x0
    cr_dump_self <cr_dump_self.c:999>, pid 17189: entering flags=0x0
    cr_dump_self <cr_dump_self.c:1019>, pid 17189: NOTIFY(&req->preshared_barrier) returning 1
    cr_signal_predump_barrier <cr_chkpt_req.c:1151>, pid 17189: ENTER(&proc_req->predump_barrier)
    cr_signal_predump_barrier <cr_chkpt_req.c:1151>, pid 17189: LEAVE(&proc_req->predump_barrier) returning 1
    cr_do_vmadump <cr_dump_self.c:777>, pid 17189: Preparing to dump 2 threads of lt-hooks
    cr_save_header <cr_dump_self.c:725>, pid 17189: Dumping header for 2 threads
    cr_signal_predump_barrier <cr_chkpt_req.c:1151>, pid 17176: LEAVE(&proc_req->predump_barrier) returning 0
    cr_do_vmadump <cr_dump_self.c:786>, pid 17189: Writing the per-process linkage.
    cr_do_vmadump <cr_dump_self.c:813>, pid 17189: Writing credentials
    cr_do_vmadump <cr_dump_self.c:854>, pid 17189: Writing vmadump.
    cr_do_vmadump <cr_dump_self.c:854>, pid 17176: Writing vmadump.
    cr_do_vmadump <cr_dump_self.c:865>, pid 17176: thread finished vmadump
    cr_do_vmadump <cr_dump_self.c:870>, pid 17176: ENTER(&proc_req->vmadump_barrier)
    cr_do_vmadump <cr_dump_self.c:865>, pid 17189: thread finished vmadump
    cr_do_vmadump <cr_dump_self.c:870>, pid 17189: ENTER(&proc_req->vmadump_barrier)
    cr_do_vmadump <cr_dump_self.c:870>, pid 17189: LEAVE(&proc_req->vmadump_barrier) returning 1
    cr_do_vmadump <cr_dump_self.c:871>, pid 17189: process finished vmadump
    cr_do_vmadump <cr_dump_self.c:877>, pid 17189: Writing the fs struct...
    cr_do_vmadump <cr_dump_self.c:870>, pid 17176: LEAVE(&proc_req->vmadump_barrier) returning 0
    cr_do_vmadump <cr_dump_self.c:885>, pid 17189: Writing the mmap()s table (if any)...
    cr_do_vmadump <cr_dump_self.c:894>, pid 17189: Writing POSIX interval timers...
    cr_do_vmadump <cr_dump_self.c:915>, pid 17189: Writing the open file section...
    cr_save_all_files <cr_dump_self.c:556>, pid 17189: entering 
    cr_save_all_files <cr_dump_self.c:559>, pid 17189:     ...files_struct
    cr_save_all_files <cr_dump_self.c:567>, pid 17189:     ...files
    cr_save_all_files <cr_dump_self.c:634>, pid 17189:     ...0 is open character device.
    cr_save_all_files <cr_dump_self.c:642>, pid 17189:     ...1 is dup of 000001065b4f6380
    cr_save_all_files <cr_dump_self.c:642>, pid 17189:     ...2 is dup of 000001065b4f6380
    cr_save_all_files <cr_dump_self.c:614>, pid 17189:     ...3 is regular file.
    cr_save_all_files <cr_dump_self.c:583>, pid 17189: fd 4 is the context file - skipping
    cr_save_all_files <cr_dump_self.c:646>, pid 17189:     ...5 is a checkpoint request.
    cr_do_vmadump <cr_dump_self.c:923>, pid 17189: Writing mmap()ed pages (if any)...
    cr_dump_self <cr_dump_self.c:1114>, pid 17189: ENTER(&req->postdump_barrier)
    cr_dump_self <cr_dump_self.c:1114>, pid 17176: ENTER(&req->postdump_barrier)
    cr_dump_self <cr_dump_self.c:1114>, pid 17176: LEAVE(&req->postdump_barrier) returning 1
    cr_dump_self <cr_dump_self.c:1119>, pid 17176: Writing the trailer.
    cr_save_header <cr_dump_self.c:725>, pid 17176: Dumping header for 0 threads
    cr_dump_self <cr_dump_self.c:1151>, pid 17176: leaving Returning 0
    ctrl_ioctl <cr_fops.c:127>, pid 17176: entering op=4008a108 arg=0xffffffffffffffff
    cr_hand_complete <cr_fops.c:42>, pid 17176: entering 
    cr_signal_chkpt_complete_barrier <cr_chkpt_req.c:1182>, pid 17176: ENTER(&proc_req->pre_complete_barrier)
    cr_dump_self <cr_dump_self.c:1114>, pid 17189: LEAVE(&req->postdump_barrier) returning 0
    cr_dump_self <cr_dump_self.c:1151>, pid 17189: leaving Returning 0
    ctrl_ioctl <cr_fops.c:127>, pid 17189: entering op=4008a108 arg=0xffffffffffffffff
    cr_hand_complete <cr_fops.c:42>, pid 17189: entering 
    cr_signal_chkpt_complete_barrier <cr_chkpt_req.c:1182>, pid 17189: ENTER(&proc_req->pre_complete_barrier)
    cr_signal_chkpt_complete_barrier <cr_chkpt_req.c:1182>, pid 17189: LEAVE(&proc_req->pre_complete_barrier) returning 1
    cr_chkpt_task_complete <cr_chkpt_req.c:1310>, pid 17189: ENTER(&proc_req->post_complete_barrier)
    cr_signal_chkpt_complete_barrier <cr_chkpt_req.c:1182>, pid 17176: LEAVE(&proc_req->pre_complete_barrier) returning 0
    cr_chkpt_task_complete <cr_chkpt_req.c:1310>, pid 17176: ENTER(&proc_req->post_complete_barrier)
    cr_chkpt_task_complete <cr_chkpt_req.c:1310>, pid 17176: LEAVE(&proc_req->post_complete_barrier) returning 1
    cr_hand_complete <cr_fops.c:66>, pid 17176: leaving Returning 0
    ctrl_ioctl <cr_fops.c:127>, pid 17176: entering op=c008a111 arg=0x0
    cr_chkpt_done <cr_chkpt_req.c:1387>, pid 17176: entering 
    cr_chkpt_task_complete <cr_chkpt_req.c:1310>, pid 17189: LEAVE(&proc_req->post_complete_barrier) returning 0
    __cr_task_put <cr_task.c:126>, pid 17189: Free cr_task_t 00000102a44cecd0
    cr_hand_complete <cr_fops.c:66>, pid 17189: leaving Returning 0
    cr_chkpt_done <cr_chkpt_req.c:1428>, pid 17176: leaving Returning 1
    ctrl_ioctl <cr_fops.c:127>, pid 17176: entering op=0000a112 arg=0xffffffffffffffff
    ctrl_release <cr_fops.c:240>, pid 17176: entering 
    release_request <cr_chkpt_req.c:52>, pid 17176: Free cr_chkpt_req_t 0000010174b64040
    ctrl_release <cr_fops.c:240>, pid 17176: entering 
    ctrl_release <cr_fops.c:240>, pid 17189: entering 
    __cr_task_put <cr_task.c:126>, pid 17189: Free cr_task_t 00000102f26399c8
    ctrl_open <cr_fops.c:225>, pid 17190: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17190: entering op=4008a130 arg=0x8
    ctrl_ioctl <cr_fops.c:127>, pid 17190: entering op=4008a107 arg=0x3
    cr_phase2_register <cr_sync.c:73>, pid 17190: entering 
    __cr_task_get <cr_task.c:98>, pid 17190: Alloc cr_task_t 00000102f26399c8 for pid 17190
    ctrl_ioctl <cr_fops.c:127>, pid 17212: entering op=4008a105 arg=0x3
    cr_phase1_register <cr_async.c:145>, pid 17212: entering 
    __cr_task_get <cr_task.c:98>, pid 17212: Alloc cr_task_t 00000102a44cecd0 for pid 17212
    ctrl_ioctl <cr_fops.c:127>, pid 17212: entering op=c008a106 arg=0x0
    cr_suspend <cr_async.c:79>, pid 17212: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17190: entering op=4008a120 arg=0x7fbffff210
    cr_rstrt_request_restart <cr_rstrt_req.c:765>, pid 17190: entering 
    alloc_rstrt_req <cr_rstrt_req.c:71>, pid 17190: Alloc cr_rstrt_req_t 000001043e2d0e80
    cr_loc_init <cr_dest_file.c:158>, pid 17190: Calling do_init_reg on fd 4
    cr_rstrt_request_restart <cr_rstrt_req.c:826>, pid 17190: cr_magic = 67 82, cr_version = 7, scope = 0, arch = 5.
    ctrl_ioctl <cr_fops.c:127>, pid 17190: entering op=8008a126 arg=0x7fbfffec50
    cr_rstrt_procs <cr_rstrt_req.c:876>, pid 17190: entering 
    cr_rstrt_procs <cr_rstrt_req.c:1000>, pid 17190: leaving Returning 1
    ctrl_ioctl <cr_fops.c:127>, pid 17190: entering op=8008a126 arg=0x7fbfffec50
    cr_rstrt_procs <cr_rstrt_req.c:876>, pid 17190: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17213: entering op=0000a123 arg=0xffffffffffffffff
    cr_rstrt_child <cr_rstrt_req.c:2478>, pid 17213: entering 
    __cr_task_get <cr_task.c:98>, pid 17213: Alloc cr_task_t 00000102f2639140 for pid 17213
    cr_rstrt_child <cr_rstrt_req.c:2518>, pid 17213: NOTIFY(&proc_req->vmadump_barrier) returning 0
    cr_reserve_ids <cr_rstrt_req.c:501>, pid 17213: Now reserving required ids... 
    cr_reserve_ids <cr_rstrt_req.c:501>, pid 17213: Now reserving required ids... 
    cr_rstrt_child <cr_rstrt_req.c:2586>, pid 17213: 17213: Restoring credentials
    ctrl_ioctl <cr_fops.c:127>, pid 17214: entering op=0000a123 arg=0xffffffffffffffff
    cr_rstrt_child <cr_rstrt_req.c:2478>, pid 17214: entering 
    __cr_task_get <cr_task.c:98>, pid 17214: Alloc cr_task_t 00000102a44ced78 for pid 17214
    cr_rstrt_child <cr_rstrt_req.c:2518>, pid 17214: NOTIFY(&proc_req->vmadump_barrier) returning 1
    cr_rstrt_child <cr_rstrt_req.c:2659>, pid 17213: Formerly lt-hooks PID 17176
    cr_restore_pids <cr_rstrt_req.c:1379>, pid 17213: ENTER_INTERRUPTIBLE(&proc_req->linkage_barrier)
    cr_rstrt_child <cr_rstrt_req.c:2659>, pid 17214: Formerly lt-hooks PID 17189
    cr_restore_pids <cr_rstrt_req.c:1363>, pid 17214: Now restoring the pids... 
    cr_restore_pids <cr_rstrt_req.c:1370>, pid 17189: Linkage restore finished...
    cr_restore_pids <cr_rstrt_req.c:1379>, pid 17189: ENTER_INTERRUPTIBLE(&proc_req->linkage_barrier)
    cr_restore_pids <cr_rstrt_req.c:1379>, pid 17189: LEAVE(&proc_req->linkage_barrier) returning 1
    cr_restore_pids <cr_rstrt_req.c:1379>, pid 17176: LEAVE(&proc_req->linkage_barrier) returning 0
    cr_rstrt_child <cr_rstrt_req.c:2707>, pid 17189: 17189: loading mmap()s table
    cr_rstrt_child <cr_rstrt_req.c:2720>, pid 17189: Reading POSIX interval timers...
    cr_restore_all_files <cr_rstrt_req.c:2017>, pid 17189: close-on-exec of callers files
    cr_restore_all_files <cr_rstrt_req.c:2031>, pid 17189: recovering fs_struct...
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17189: entering 
    cr_restore_all_files <cr_rstrt_req.c:2062>, pid 17189:    fd=0 dnr=1
    cr_restore_open_chr <cr_rstrt_req.c:1752>, pid 17189: entering 
    cr_restore_open_chr <cr_rstrt_req.c:1809>, pid 17189:    Character device.  major=5, minor=0 path='/dev/tty'
    cr_restore_file_locks <cr_rstrt_req.c:1969>, pid 17189: entering 
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17189: entering 
    cr_restore_all_files <cr_rstrt_req.c:2062>, pid 17189:    fd=1 dnr=1
    cr_restore_open_dup <cr_rstrt_req.c:1886>, pid 17189: entering 
    cr_restore_open_dup <cr_rstrt_req.c:1912>, pid 17189: cr_dup2(000001065b4f6380 -> 1) successful
    cr_restore_file_locks <cr_rstrt_req.c:1969>, pid 17189: entering 
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17189: entering 
    cr_restore_all_files <cr_rstrt_req.c:2062>, pid 17189:    fd=2 dnr=1
    cr_restore_open_dup <cr_rstrt_req.c:1886>, pid 17189: entering 
    cr_restore_open_dup <cr_rstrt_req.c:1912>, pid 17189: cr_dup2(000001065b4f6380 -> 2) successful
    cr_restore_file_locks <cr_rstrt_req.c:1969>, pid 17189: entering 
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17189: entering 
    cr_restore_all_files <cr_rstrt_req.c:2062>, pid 17189:    fd=3 dnr=0
    cr_restore_open_file <cr_rstrt_req.c:1548>, pid 17189: entering 
    ctrl_open <cr_fops.c:225>, pid 17189: entering 
    cr_restore_file_locks <cr_rstrt_req.c:1969>, pid 17189: entering 
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17189: entering 
    cr_restore_all_files <cr_rstrt_req.c:2062>, pid 17189:    fd=5 dnr=0
    cr_restore_open_chkpt_req <cr_rstrt_req.c:1927>, pid 17189: entering 
    cr_restore_open_file <cr_rstrt_req.c:1548>, pid 17189: entering 
    ctrl_open <cr_fops.c:225>, pid 17189: entering 
    cr_restore_file_locks <cr_rstrt_req.c:1969>, pid 17189: entering 
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17189: entering 
    cr_end_of_file_restore <cr_rstrt_req.c:1957>, pid 17189: entering 
    cr_finish_all_file_restores <cr_rstrt_req.c:1982>, pid 17189: entering 
    cr_finish_all_file_restores <cr_rstrt_req.c:1985>, pid 17189: current->files=0000010663d32280
    cr_finish_all_file_restores <cr_rstrt_req.c:1990>, pid 17189: fd=0 filp=000001065b4f6380 filp->dentry=0000010113566268 d_count=2 d_inode=0000010666433d88
    cr_finish_all_file_restores <cr_rstrt_req.c:1990>, pid 17189: fd=1 filp=000001065b4f6380 filp->dentry=0000010113566268 d_count=2 d_inode=0000010666433d88
    cr_finish_all_file_restores <cr_rstrt_req.c:1990>, pid 17189: fd=2 filp=000001065b4f6380 filp->dentry=0000010113566268 d_count=2 d_inode=0000010666433d88
    cr_finish_all_file_restores <cr_rstrt_req.c:1990>, pid 17189: fd=3 filp=00000101e6ac5c80 filp->dentry=00000106681d59a8 d_count=4 d_inode=0000010397f5e7a0
    cr_finish_all_file_restores <cr_rstrt_req.c:1990>, pid 17189: fd=5 filp=000001065fceeec0 filp->dentry=00000106681d59a8 d_count=4 d_inode=0000010397f5e7a0
    cr_rstrt_child <cr_rstrt_req.c:2759>, pid 17189: 17189: closing request descriptor
    cr_rstrt_child <cr_rstrt_req.c:2770>, pid 17189: 17189: closing context file descriptor
    cr_rstrt_child <cr_rstrt_req.c:2826>, pid 17189: NOTIFY(&req->barrier) returning 0
    cr_rstrt_child <cr_rstrt_req.c:2826>, pid 17176: NOTIFY(&req->barrier) returning 0
    cr_restore_parents <cr_rstrt_req.c:676>, pid 17190: Now restoring the parent linkage... 
    cr_rstrt_procs <cr_rstrt_req.c:997>, pid 17190: NOTIFY(&req->barrier) returning 1
    cr_rstrt_procs <cr_rstrt_req.c:1000>, pid 17190: leaving Returning 0
    ctrl_ioctl <cr_fops.c:127>, pid 17190: entering op=c008a121 arg=0x0
    cr_rstrt_done <cr_rstrt_req.c:1052>, pid 17190: entering 
    cr_rstrt_child <cr_rstrt_req.c:2846>, pid 17176: leaving Returning 17190
    ctrl_ioctl <cr_fops.c:127>, pid 17176: entering op=4008a108 arg=0xffffffffffffffff
    cr_hand_complete <cr_fops.c:42>, pid 17176: entering 
    cr_signal_rstrt_complete_barrier <cr_rstrt_req.c:2282>, pid 17176: ENTER(&proc_req->pre_complete_barrier)
    cr_rstrt_child <cr_rstrt_req.c:2846>, pid 17189: leaving Returning 17190
    ctrl_ioctl <cr_fops.c:127>, pid 17189: entering op=4008a108 arg=0xffffffffffffffff
    cr_hand_complete <cr_fops.c:42>, pid 17189: entering 
    cr_signal_rstrt_complete_barrier <cr_rstrt_req.c:2282>, pid 17189: ENTER(&proc_req->pre_complete_barrier)
    cr_signal_rstrt_complete_barrier <cr_rstrt_req.c:2282>, pid 17189: LEAVE(&proc_req->pre_complete_barrier) returning 1
    cr_rstrt_task_complete <cr_rstrt_req.c:2447>, pid 17189: ENTER(&proc_req->post_complete_barrier)
    cr_signal_rstrt_complete_barrier <cr_rstrt_req.c:2282>, pid 17176: LEAVE(&proc_req->pre_complete_barrier) returning 0
    cr_rstrt_task_complete <cr_rstrt_req.c:2447>, pid 17176: ENTER(&proc_req->post_complete_barrier)
    cr_rstrt_task_complete <cr_rstrt_req.c:2447>, pid 17176: LEAVE(&proc_req->post_complete_barrier) returning 1
    release_rstrt_req <cr_rstrt_req.c:107>, pid 17176: ref count is approximately 4
    cr_hand_complete <cr_fops.c:66>, pid 17176: leaving Returning 0
    ctrl_ioctl <cr_fops.c:127>, pid 17176: entering op=c008a111 arg=0x0
    cr_chkpt_done <cr_chkpt_req.c:1387>, pid 17176: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17176: entering op=0000a112 arg=0xffffffffffffffff
    ctrl_release <cr_fops.c:240>, pid 17176: entering 
    cr_rstrt_task_complete <cr_rstrt_req.c:2447>, pid 17189: LEAVE(&proc_req->post_complete_barrier) returning 0
    release_rstrt_req <cr_rstrt_req.c:107>, pid 17189: ref count is approximately 3
    __cr_task_put <cr_task.c:126>, pid 17189: Free cr_task_t 00000102a44ced78
    cr_hand_complete <cr_fops.c:66>, pid 17189: leaving Returning 0
    release_rstrt_req <cr_rstrt_req.c:107>, pid 17190: ref count is approximately 2
    cr_rstrt_done <cr_rstrt_req.c:1091>, pid 17190: leaving Returning 1
    ctrl_ioctl <cr_fops.c:127>, pid 17190: entering op=0000a122 arg=0xffffffffffffffff
    cr_rstrt_reap <cr_rstrt_req.c:1109>, pid 17190: entering 
    release_rstrt_req <cr_rstrt_req.c:107>, pid 17190: ref count is approximately 1
    release_rstrt_req <cr_rstrt_req.c:127>, pid 17190: Releasing source file
    release_rstrt_req <cr_rstrt_req.c:130>, pid 17190: fput()'ing stdin/out
    release_rstrt_req <cr_rstrt_req.c:133>, pid 17190: put_task_struct(cr_restart_task)
    release_rstrt_req <cr_rstrt_req.c:139>, pid 17190: Free cr_rstrt_req_t 000001043e2d0e80
    cr_rstrt_reap <cr_rstrt_req.c:1125>, pid 17190: leaving Returning 17176
    ctrl_release <cr_fops.c:240>, pid 17176: entering 
    __cr_task_put <cr_task.c:126>, pid 17176: Free cr_task_t 00000102f2639140
    cr_suspend <cr_async.c:117>, pid 17212: leaving with pending signal
    ctrl_release <cr_fops.c:240>, pid 17212: entering 
    __cr_task_put <cr_task.c:126>, pid 17212: Free cr_task_t 00000102a44cecd0
    __cr_task_put <cr_task.c:126>, pid 17212: Free cr_task_t 00000102f26399c8
    ctrl_open <cr_fops.c:225>, pid 17215: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17215: entering op=4008a130 arg=0x8
    ctrl_ioctl <cr_fops.c:127>, pid 17215: entering op=4008a107 arg=0x3
    cr_phase2_register <cr_sync.c:73>, pid 17215: entering 
    __cr_task_get <cr_task.c:98>, pid 17215: Alloc cr_task_t 00000102f26399c8 for pid 17215
    ctrl_open <cr_fops.c:225>, pid 17215: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17215: entering op=4008a130 arg=0x8
    ctrl_ioctl <cr_fops.c:127>, pid 17215: entering op=4008a110 arg=0x7fbfffe790
    cr_chkpt_req <cr_chkpt_req.c:856>, pid 17215: entering 
    cr_log_request <cr_chkpt_req.c:834>, pid 17215: checkpointing its own process 17215
    cr_chkpt_req <cr_chkpt_req.c:878>, pid 17215:  checkpoint params:  secs= 0, opts=0000000000000000, fd=4
    alloc_request <cr_chkpt_req.c:254>, pid 17215: Alloc cr_chkpt_req_t 0000010174b64040
    ctrl_open <cr_fops.c:225>, pid 17215: entering 
    cr_loc_init <cr_dest_file.c:158>, pid 17215: Calling do_init_reg on fd 4
    add_proc <cr_chkpt_req.c:562>, pid 17215: Add proc pid=17215
    add_task <cr_chkpt_req.c:436>, pid 17215: entering task=0000010295bea030 (17215)
    do_trigger <cr_trigger.c:94>, pid 17215: triggered pid 17215 (lt-hooks) w/ retval=0
    ctrl_ioctl <cr_fops.c:127>, pid 17215: entering op=4008a101 arg=0x0
    cr_dump_self <cr_dump_self.c:999>, pid 17215: entering flags=0x0
    cr_dump_self <cr_dump_self.c:1019>, pid 17215: NOTIFY(&req->preshared_barrier) returning 1
    cr_save_file_header <cr_dump_self.c:697>, pid 17215: Dumping file header
    cr_signal_predump_barrier <cr_chkpt_req.c:1151>, pid 17215: ENTER(&proc_req->predump_barrier)
    cr_signal_predump_barrier <cr_chkpt_req.c:1151>, pid 17215: LEAVE(&proc_req->predump_barrier) returning 1
    cr_do_vmadump <cr_dump_self.c:777>, pid 17215: Preparing to dump 1 threads of lt-hooks
    cr_save_header <cr_dump_self.c:725>, pid 17215: Dumping header for 1 threads
    cr_do_vmadump <cr_dump_self.c:786>, pid 17215: Writing the per-process linkage.
    cr_do_vmadump <cr_dump_self.c:813>, pid 17215: Writing credentials
    cr_do_vmadump <cr_dump_self.c:854>, pid 17215: Writing vmadump.
    cr_do_vmadump <cr_dump_self.c:865>, pid 17215: thread finished vmadump
    cr_do_vmadump <cr_dump_self.c:870>, pid 17215: ENTER(&proc_req->vmadump_barrier)
    cr_do_vmadump <cr_dump_self.c:870>, pid 17215: LEAVE(&proc_req->vmadump_barrier) returning 1
    cr_do_vmadump <cr_dump_self.c:871>, pid 17215: process finished vmadump
    cr_do_vmadump <cr_dump_self.c:877>, pid 17215: Writing the fs struct...
    cr_do_vmadump <cr_dump_self.c:885>, pid 17215: Writing the mmap()s table (if any)...
    cr_do_vmadump <cr_dump_self.c:894>, pid 17215: Writing POSIX interval timers...
    cr_do_vmadump <cr_dump_self.c:915>, pid 17215: Writing the open file section...
    cr_save_all_files <cr_dump_self.c:556>, pid 17215: entering 
    cr_save_all_files <cr_dump_self.c:559>, pid 17215:     ...files_struct
    cr_save_all_files <cr_dump_self.c:567>, pid 17215:     ...files
    cr_save_all_files <cr_dump_self.c:634>, pid 17215:     ...0 is open character device.
    cr_save_all_files <cr_dump_self.c:642>, pid 17215:     ...1 is dup of 000001065b4f6380
    cr_save_all_files <cr_dump_self.c:642>, pid 17215:     ...2 is dup of 000001065b4f6380
    cr_save_all_files <cr_dump_self.c:614>, pid 17215:     ...3 is regular file.
    cr_save_all_files <cr_dump_self.c:583>, pid 17215: fd 4 is the context file - skipping
    cr_save_all_files <cr_dump_self.c:646>, pid 17215:     ...5 is a checkpoint request.
    cr_do_vmadump <cr_dump_self.c:923>, pid 17215: Writing mmap()ed pages (if any)...
    cr_dump_self <cr_dump_self.c:1114>, pid 17215: ENTER(&req->postdump_barrier)
    cr_dump_self <cr_dump_self.c:1114>, pid 17215: LEAVE(&req->postdump_barrier) returning 1
    cr_dump_self <cr_dump_self.c:1119>, pid 17215: Writing the trailer.
    cr_save_header <cr_dump_self.c:725>, pid 17215: Dumping header for 0 threads
    cr_dump_self <cr_dump_self.c:1151>, pid 17215: leaving Returning 0
    ctrl_ioctl <cr_fops.c:127>, pid 17215: entering op=4008a108 arg=0xffffffffffffffff
    cr_hand_complete <cr_fops.c:42>, pid 17215: entering 
    cr_signal_chkpt_complete_barrier <cr_chkpt_req.c:1182>, pid 17215: ENTER(&proc_req->pre_complete_barrier)
    cr_signal_chkpt_complete_barrier <cr_chkpt_req.c:1182>, pid 17215: LEAVE(&proc_req->pre_complete_barrier) returning 1
    cr_chkpt_task_complete <cr_chkpt_req.c:1310>, pid 17215: ENTER(&proc_req->post_complete_barrier)
    cr_chkpt_task_complete <cr_chkpt_req.c:1310>, pid 17215: LEAVE(&proc_req->post_complete_barrier) returning 1
    cr_hand_complete <cr_fops.c:66>, pid 17215: leaving Returning 0
    ctrl_ioctl <cr_fops.c:127>, pid 17215: entering op=c008a111 arg=0x0
    cr_chkpt_done <cr_chkpt_req.c:1387>, pid 17215: entering 
    cr_chkpt_done <cr_chkpt_req.c:1428>, pid 17215: leaving Returning 1
    ctrl_ioctl <cr_fops.c:127>, pid 17215: entering op=0000a112 arg=0xffffffffffffffff
    ctrl_release <cr_fops.c:240>, pid 17215: entering 
    release_request <cr_chkpt_req.c:52>, pid 17215: Free cr_chkpt_req_t 0000010174b64040
    ctrl_release <cr_fops.c:240>, pid 17215: entering 
    ctrl_release <cr_fops.c:240>, pid 17215: entering 
    __cr_task_put <cr_task.c:126>, pid 17215: Free cr_task_t 00000102f26399c8
    ctrl_open <cr_fops.c:225>, pid 17228: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17228: entering op=4008a130 arg=0x8
    ctrl_ioctl <cr_fops.c:127>, pid 17228: entering op=4008a107 arg=0x3
    cr_phase2_register <cr_sync.c:73>, pid 17228: entering 
    __cr_task_get <cr_task.c:98>, pid 17228: Alloc cr_task_t 00000102f26399c8 for pid 17228
    ctrl_ioctl <cr_fops.c:127>, pid 17250: entering op=4008a105 arg=0x3
    cr_phase1_register <cr_async.c:145>, pid 17250: entering 
    __cr_task_get <cr_task.c:98>, pid 17250: Alloc cr_task_t 00000102a44cecd0 for pid 17250
    ctrl_ioctl <cr_fops.c:127>, pid 17250: entering op=c008a106 arg=0x0
    cr_suspend <cr_async.c:79>, pid 17250: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17228: entering op=4008a120 arg=0x7fbffff210
    cr_rstrt_request_restart <cr_rstrt_req.c:765>, pid 17228: entering 
    alloc_rstrt_req <cr_rstrt_req.c:71>, pid 17228: Alloc cr_rstrt_req_t 000001043e2d0e80
    cr_loc_init <cr_dest_file.c:158>, pid 17228: Calling do_init_reg on fd 4
    cr_rstrt_request_restart <cr_rstrt_req.c:826>, pid 17228: cr_magic = 67 82, cr_version = 7, scope = 0, arch = 5.
    ctrl_ioctl <cr_fops.c:127>, pid 17228: entering op=8008a126 arg=0x7fbfffec50
    cr_rstrt_procs <cr_rstrt_req.c:876>, pid 17228: entering 
    cr_rstrt_procs <cr_rstrt_req.c:1000>, pid 17228: leaving Returning 1
    ctrl_ioctl <cr_fops.c:127>, pid 17251: entering op=0000a123 arg=0xffffffffffffffff
    cr_rstrt_child <cr_rstrt_req.c:2478>, pid 17251: entering 
    __cr_task_get <cr_task.c:98>, pid 17251: Alloc cr_task_t 00000102f2639140 for pid 17251
    cr_rstrt_child <cr_rstrt_req.c:2518>, pid 17251: NOTIFY(&proc_req->vmadump_barrier) returning 1
    cr_reserve_ids <cr_rstrt_req.c:501>, pid 17251: Now reserving required ids... 
    cr_reserve_ids <cr_rstrt_req.c:501>, pid 17251: Now reserving required ids... 
    cr_rstrt_child <cr_rstrt_req.c:2586>, pid 17251: 17251: Restoring credentials
    ctrl_ioctl <cr_fops.c:127>, pid 17228: entering op=8008a126 arg=0x7fbfffec50
    cr_rstrt_procs <cr_rstrt_req.c:876>, pid 17228: entering 
    cr_rstrt_child <cr_rstrt_req.c:2659>, pid 17251: Formerly lt-hooks PID 17215
    cr_restore_pids <cr_rstrt_req.c:1363>, pid 17251: Now restoring the pids... 
    cr_restore_pids <cr_rstrt_req.c:1370>, pid 17215: Linkage restore finished...
    cr_restore_pids <cr_rstrt_req.c:1379>, pid 17215: ENTER_INTERRUPTIBLE(&proc_req->linkage_barrier)
    cr_restore_pids <cr_rstrt_req.c:1379>, pid 17215: LEAVE(&proc_req->linkage_barrier) returning 1
    cr_rstrt_child <cr_rstrt_req.c:2707>, pid 17215: 17215: loading mmap()s table
    cr_rstrt_child <cr_rstrt_req.c:2720>, pid 17215: Reading POSIX interval timers...
    cr_restore_all_files <cr_rstrt_req.c:2017>, pid 17215: close-on-exec of callers files
    cr_restore_all_files <cr_rstrt_req.c:2031>, pid 17215: recovering fs_struct...
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17215: entering 
    cr_restore_all_files <cr_rstrt_req.c:2062>, pid 17215:    fd=0 dnr=1
    cr_restore_open_chr <cr_rstrt_req.c:1752>, pid 17215: entering 
    cr_restore_open_chr <cr_rstrt_req.c:1809>, pid 17215:    Character device.  major=5, minor=0 path='/dev/tty'
    cr_restore_file_locks <cr_rstrt_req.c:1969>, pid 17215: entering 
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17215: entering 
    cr_restore_all_files <cr_rstrt_req.c:2062>, pid 17215:    fd=1 dnr=1
    cr_restore_open_dup <cr_rstrt_req.c:1886>, pid 17215: entering 
    cr_restore_open_dup <cr_rstrt_req.c:1912>, pid 17215: cr_dup2(000001065b4f6380 -> 1) successful
    cr_restore_file_locks <cr_rstrt_req.c:1969>, pid 17215: entering 
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17215: entering 
    cr_restore_all_files <cr_rstrt_req.c:2062>, pid 17215:    fd=2 dnr=1
    cr_restore_open_dup <cr_rstrt_req.c:1886>, pid 17215: entering 
    cr_restore_open_dup <cr_rstrt_req.c:1912>, pid 17215: cr_dup2(000001065b4f6380 -> 2) successful
    cr_restore_file_locks <cr_rstrt_req.c:1969>, pid 17215: entering 
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17215: entering 
    cr_restore_all_files <cr_rstrt_req.c:2062>, pid 17215:    fd=3 dnr=0
    cr_restore_open_file <cr_rstrt_req.c:1548>, pid 17215: entering 
    ctrl_open <cr_fops.c:225>, pid 17215: entering 
    cr_restore_file_locks <cr_rstrt_req.c:1969>, pid 17215: entering 
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17215: entering 
    cr_restore_all_files <cr_rstrt_req.c:2062>, pid 17215:    fd=5 dnr=0
    cr_restore_open_chkpt_req <cr_rstrt_req.c:1927>, pid 17215: entering 
    cr_restore_open_file <cr_rstrt_req.c:1548>, pid 17215: entering 
    ctrl_open <cr_fops.c:225>, pid 17215: entering 
    cr_restore_file_locks <cr_rstrt_req.c:1969>, pid 17215: entering 
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17215: entering 
    cr_end_of_file_restore <cr_rstrt_req.c:1957>, pid 17215: entering 
    cr_finish_all_file_restores <cr_rstrt_req.c:1982>, pid 17215: entering 
    cr_finish_all_file_restores <cr_rstrt_req.c:1985>, pid 17215: current->files=0000010666770200
    cr_finish_all_file_restores <cr_rstrt_req.c:1990>, pid 17215: fd=0 filp=000001065b4f6380 filp->dentry=0000010113566268 d_count=2 d_inode=0000010666433d88
    cr_finish_all_file_restores <cr_rstrt_req.c:1990>, pid 17215: fd=1 filp=000001065b4f6380 filp->dentry=0000010113566268 d_count=2 d_inode=0000010666433d88
    cr_finish_all_file_restores <cr_rstrt_req.c:1990>, pid 17215: fd=2 filp=000001065b4f6380 filp->dentry=0000010113566268 d_count=2 d_inode=0000010666433d88
    cr_finish_all_file_restores <cr_rstrt_req.c:1990>, pid 17215: fd=3 filp=000001027d444380 filp->dentry=00000106681d59a8 d_count=4 d_inode=0000010397f5e7a0
    cr_finish_all_file_restores <cr_rstrt_req.c:1990>, pid 17215: fd=5 filp=0000010612aba880 filp->dentry=00000106681d59a8 d_count=4 d_inode=0000010397f5e7a0
    cr_rstrt_child <cr_rstrt_req.c:2759>, pid 17215: 17215: closing request descriptor
    cr_rstrt_child <cr_rstrt_req.c:2770>, pid 17215: 17215: closing context file descriptor
    cr_rstrt_child <cr_rstrt_req.c:2826>, pid 17215: NOTIFY(&req->barrier) returning 0
    cr_restore_parents <cr_rstrt_req.c:676>, pid 17228: Now restoring the parent linkage... 
    cr_rstrt_procs <cr_rstrt_req.c:997>, pid 17228: NOTIFY(&req->barrier) returning 1
    cr_rstrt_procs <cr_rstrt_req.c:1000>, pid 17228: leaving Returning 0
    ctrl_ioctl <cr_fops.c:127>, pid 17228: entering op=c008a121 arg=0x0
    cr_rstrt_done <cr_rstrt_req.c:1052>, pid 17228: entering 
    cr_rstrt_child <cr_rstrt_req.c:2846>, pid 17215: leaving Returning 17228
    ctrl_ioctl <cr_fops.c:127>, pid 17215: entering op=4008a108 arg=0xffffffffffffffff
    cr_hand_complete <cr_fops.c:42>, pid 17215: entering 
    cr_signal_rstrt_complete_barrier <cr_rstrt_req.c:2282>, pid 17215: ENTER(&proc_req->pre_complete_barrier)
    cr_signal_rstrt_complete_barrier <cr_rstrt_req.c:2282>, pid 17215: LEAVE(&proc_req->pre_complete_barrier) returning 1
    cr_rstrt_task_complete <cr_rstrt_req.c:2447>, pid 17215: ENTER(&proc_req->post_complete_barrier)
    cr_rstrt_task_complete <cr_rstrt_req.c:2447>, pid 17215: LEAVE(&proc_req->post_complete_barrier) returning 1
    release_rstrt_req <cr_rstrt_req.c:107>, pid 17215: ref count is approximately 3
    cr_hand_complete <cr_fops.c:66>, pid 17215: leaving Returning 0
    release_rstrt_req <cr_rstrt_req.c:107>, pid 17228: ref count is approximately 2
    cr_rstrt_done <cr_rstrt_req.c:1091>, pid 17228: leaving Returning 1
    ctrl_ioctl <cr_fops.c:127>, pid 17228: entering op=0000a122 arg=0xffffffffffffffff
    cr_rstrt_reap <cr_rstrt_req.c:1109>, pid 17228: entering 
    release_rstrt_req <cr_rstrt_req.c:107>, pid 17228: ref count is approximately 1
    release_rstrt_req <cr_rstrt_req.c:127>, pid 17228: Releasing source file
    release_rstrt_req <cr_rstrt_req.c:130>, pid 17228: fput()'ing stdin/out
    release_rstrt_req <cr_rstrt_req.c:133>, pid 17228: put_task_struct(cr_restart_task)
    release_rstrt_req <cr_rstrt_req.c:139>, pid 17228: Free cr_rstrt_req_t 000001043e2d0e80
    cr_rstrt_reap <cr_rstrt_req.c:1125>, pid 17228: leaving Returning 17215
    ctrl_ioctl <cr_fops.c:127>, pid 17215: entering op=c008a111 arg=0x0
    cr_chkpt_done <cr_chkpt_req.c:1387>, pid 17215: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17215: entering op=0000a112 arg=0xffffffffffffffff
    ctrl_release <cr_fops.c:240>, pid 17215: entering 
    ctrl_release <cr_fops.c:240>, pid 17215: entering 
    __cr_task_put <cr_task.c:126>, pid 17215: Free cr_task_t 00000102f2639140
    cr_suspend <cr_async.c:117>, pid 17250: leaving with pending signal
    ctrl_release <cr_fops.c:240>, pid 17250: entering 
    __cr_task_put <cr_task.c:126>, pid 17250: Free cr_task_t 00000102a44cecd0
    __cr_task_put <cr_task.c:126>, pid 17250: Free cr_task_t 00000102f26399c8
    ctrl_open <cr_fops.c:225>, pid 17252: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17252: entering op=4008a130 arg=0x8
    ctrl_ioctl <cr_fops.c:127>, pid 17252: entering op=4008a107 arg=0x3
    cr_phase2_register <cr_sync.c:73>, pid 17252: entering 
    __cr_task_get <cr_task.c:98>, pid 17252: Alloc cr_task_t 00000102f26399c8 for pid 17252
    ctrl_ioctl <cr_fops.c:127>, pid 17265: entering op=4008a105 arg=0x3
    cr_phase1_register <cr_async.c:145>, pid 17265: entering 
    __cr_task_get <cr_task.c:98>, pid 17265: Alloc cr_task_t 00000102a44cecd0 for pid 17265
    ctrl_ioctl <cr_fops.c:127>, pid 17265: entering op=c008a106 arg=0x0
    cr_suspend <cr_async.c:79>, pid 17265: entering 
    ctrl_open <cr_fops.c:225>, pid 17252: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17252: entering op=4008a130 arg=0x8
    ctrl_ioctl <cr_fops.c:127>, pid 17252: entering op=4008a110 arg=0x7fbfffe790
    cr_chkpt_req <cr_chkpt_req.c:856>, pid 17252: entering 
    cr_log_request <cr_chkpt_req.c:834>, pid 17252: checkpointing its own process 17252
    cr_chkpt_req <cr_chkpt_req.c:878>, pid 17252:  checkpoint params:  secs= 0, opts=0000000000000000, fd=4
    alloc_request <cr_chkpt_req.c:254>, pid 17252: Alloc cr_chkpt_req_t 0000010174b64040
    ctrl_open <cr_fops.c:225>, pid 17252: entering 
    cr_loc_init <cr_dest_file.c:158>, pid 17252: Calling do_init_reg on fd 4
    add_proc <cr_chkpt_req.c:562>, pid 17252: Add proc pid=17252
    add_task <cr_chkpt_req.c:436>, pid 17252: entering task=0000010295bea030 (17252)
    add_task <cr_chkpt_req.c:436>, pid 17252: entering task=00000104c06a9030 (17265)
    do_trigger <cr_trigger.c:94>, pid 17252: triggered pid 17265 (lt-hooks) w/ retval=0
    ctrl_ioctl <cr_fops.c:127>, pid 17252: entering op=c008a111 arg=0x0
    cr_chkpt_done <cr_chkpt_req.c:1387>, pid 17252: entering 
    cr_suspend <cr_async.c:119>, pid 17265: leaving with pending checkpoint
    ctrl_ioctl <cr_fops.c:127>, pid 17265: entering op=4008a101 arg=0x0
    cr_dump_self <cr_dump_self.c:999>, pid 17265: entering flags=0x0
    cr_dump_self <cr_dump_self.c:1019>, pid 17265: NOTIFY(&req->preshared_barrier) returning 0
    cr_save_file_header <cr_dump_self.c:697>, pid 17265: Dumping file header
    cr_signal_phase_barrier <cr_chkpt_req.c:1127>, pid 17265: NOTIFY(&proc_req->phase_barrier) returning 1
    do_trigger <cr_trigger.c:94>, pid 17265: triggered pid 17252 (lt-hooks) w/ retval=0
    cr_signal_predump_barrier <cr_chkpt_req.c:1151>, pid 17265: ENTER(&proc_req->predump_barrier)
    cr_chkpt_done <cr_chkpt_req.c:1428>, pid 17252: leaving Returning -4
    ctrl_ioctl <cr_fops.c:127>, pid 17252: entering op=4008a101 arg=0x0
    cr_dump_self <cr_dump_self.c:999>, pid 17252: entering flags=0x0
    cr_dump_self <cr_dump_self.c:1019>, pid 17252: NOTIFY(&req->preshared_barrier) returning 1
    cr_signal_predump_barrier <cr_chkpt_req.c:1151>, pid 17252: ENTER(&proc_req->predump_barrier)
    cr_signal_predump_barrier <cr_chkpt_req.c:1151>, pid 17252: LEAVE(&proc_req->predump_barrier) returning 1
    cr_do_vmadump <cr_dump_self.c:777>, pid 17252: Preparing to dump 2 threads of lt-hooks
    cr_save_header <cr_dump_self.c:725>, pid 17252: Dumping header for 2 threads
    cr_do_vmadump <cr_dump_self.c:786>, pid 17252: Writing the per-process linkage.
    cr_do_vmadump <cr_dump_self.c:813>, pid 17252: Writing credentials
    cr_do_vmadump <cr_dump_self.c:854>, pid 17252: Writing vmadump.
    cr_do_vmadump <cr_dump_self.c:865>, pid 17252: thread finished vmadump
    cr_do_vmadump <cr_dump_self.c:870>, pid 17252: ENTER(&proc_req->vmadump_barrier)
    cr_signal_predump_barrier <cr_chkpt_req.c:1151>, pid 17265: LEAVE(&proc_req->predump_barrier) returning 0
    cr_do_vmadump <cr_dump_self.c:854>, pid 17265: Writing vmadump.
    cr_do_vmadump <cr_dump_self.c:865>, pid 17265: thread finished vmadump
    cr_do_vmadump <cr_dump_self.c:870>, pid 17265: ENTER(&proc_req->vmadump_barrier)
    cr_do_vmadump <cr_dump_self.c:870>, pid 17265: LEAVE(&proc_req->vmadump_barrier) returning 1
    cr_do_vmadump <cr_dump_self.c:871>, pid 17265: process finished vmadump
    cr_do_vmadump <cr_dump_self.c:877>, pid 17265: Writing the fs struct...
    cr_do_vmadump <cr_dump_self.c:870>, pid 17252: LEAVE(&proc_req->vmadump_barrier) returning 0
    cr_do_vmadump <cr_dump_self.c:885>, pid 17265: Writing the mmap()s table (if any)...
    cr_do_vmadump <cr_dump_self.c:894>, pid 17265: Writing POSIX interval timers...
    cr_do_vmadump <cr_dump_self.c:915>, pid 17265: Writing the open file section...
    cr_save_all_files <cr_dump_self.c:556>, pid 17265: entering 
    cr_save_all_files <cr_dump_self.c:559>, pid 17265:     ...files_struct
    cr_save_all_files <cr_dump_self.c:567>, pid 17265:     ...files
    cr_save_all_files <cr_dump_self.c:634>, pid 17265:     ...0 is open character device.
    cr_save_all_files <cr_dump_self.c:642>, pid 17265:     ...1 is dup of 000001065b4f6380
    cr_save_all_files <cr_dump_self.c:642>, pid 17265:     ...2 is dup of 000001065b4f6380
    cr_save_all_files <cr_dump_self.c:614>, pid 17265:     ...3 is regular file.
    cr_save_all_files <cr_dump_self.c:583>, pid 17265: fd 4 is the context file - skipping
    cr_save_all_files <cr_dump_self.c:646>, pid 17265:     ...5 is a checkpoint request.
    cr_do_vmadump <cr_dump_self.c:923>, pid 17265: Writing mmap()ed pages (if any)...
    cr_dump_self <cr_dump_self.c:1114>, pid 17265: ENTER(&req->postdump_barrier)
    cr_dump_self <cr_dump_self.c:1114>, pid 17252: ENTER(&req->postdump_barrier)
    cr_dump_self <cr_dump_self.c:1114>, pid 17252: LEAVE(&req->postdump_barrier) returning 1
    cr_dump_self <cr_dump_self.c:1119>, pid 17252: Writing the trailer.
    cr_save_header <cr_dump_self.c:725>, pid 17252: Dumping header for 0 threads
    cr_dump_self <cr_dump_self.c:1151>, pid 17252: leaving Returning 0
    ctrl_ioctl <cr_fops.c:127>, pid 17252: entering op=4008a108 arg=0xffffffffffffffff
    cr_hand_complete <cr_fops.c:42>, pid 17252: entering 
    cr_signal_chkpt_complete_barrier <cr_chkpt_req.c:1182>, pid 17252: ENTER(&proc_req->pre_complete_barrier)
    cr_dump_self <cr_dump_self.c:1114>, pid 17265: LEAVE(&req->postdump_barrier) returning 0
    cr_dump_self <cr_dump_self.c:1151>, pid 17265: leaving Returning 0
    ctrl_ioctl <cr_fops.c:127>, pid 17265: entering op=4008a108 arg=0xffffffffffffffff
    cr_hand_complete <cr_fops.c:42>, pid 17265: entering 
    cr_signal_chkpt_complete_barrier <cr_chkpt_req.c:1182>, pid 17265: ENTER(&proc_req->pre_complete_barrier)
    cr_signal_chkpt_complete_barrier <cr_chkpt_req.c:1182>, pid 17265: LEAVE(&proc_req->pre_complete_barrier) returning 1
    cr_chkpt_task_complete <cr_chkpt_req.c:1310>, pid 17265: ENTER(&proc_req->post_complete_barrier)
    cr_signal_chkpt_complete_barrier <cr_chkpt_req.c:1182>, pid 17252: LEAVE(&proc_req->pre_complete_barrier) returning 0
    cr_chkpt_task_complete <cr_chkpt_req.c:1310>, pid 17252: ENTER(&proc_req->post_complete_barrier)
    cr_chkpt_task_complete <cr_chkpt_req.c:1310>, pid 17252: LEAVE(&proc_req->post_complete_barrier) returning 1
    cr_hand_complete <cr_fops.c:66>, pid 17252: leaving Returning 0
    ctrl_ioctl <cr_fops.c:127>, pid 17252: entering op=c008a111 arg=0x0
    cr_chkpt_done <cr_chkpt_req.c:1387>, pid 17252: entering 
    cr_chkpt_task_complete <cr_chkpt_req.c:1310>, pid 17265: LEAVE(&proc_req->post_complete_barrier) returning 0
    cr_hand_complete <cr_fops.c:66>, pid 17265: leaving Returning 0
    cr_chkpt_done <cr_chkpt_req.c:1428>, pid 17252: leaving Returning 1
    ctrl_ioctl <cr_fops.c:127>, pid 17252: entering op=0000a112 arg=0xffffffffffffffff
    ctrl_release <cr_fops.c:240>, pid 17252: entering 
    release_request <cr_chkpt_req.c:52>, pid 17252: Free cr_chkpt_req_t 0000010174b64040
    ctrl_release <cr_fops.c:240>, pid 17252: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17265: entering op=c008a106 arg=0x0
    cr_suspend <cr_async.c:79>, pid 17265: entering 
    cr_suspend <cr_async.c:117>, pid 17265: leaving with pending signal
    ctrl_release <cr_fops.c:240>, pid 17265: entering 
    __cr_task_put <cr_task.c:126>, pid 17265: Free cr_task_t 00000102a44cecd0
    __cr_task_put <cr_task.c:126>, pid 17265: Free cr_task_t 00000102f26399c8
    ctrl_open <cr_fops.c:225>, pid 17266: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17266: entering op=4008a130 arg=0x8
    ctrl_ioctl <cr_fops.c:127>, pid 17266: entering op=4008a107 arg=0x3
    cr_phase2_register <cr_sync.c:73>, pid 17266: entering 
    __cr_task_get <cr_task.c:98>, pid 17266: Alloc cr_task_t 00000102a44cec28 for pid 17266
    ctrl_ioctl <cr_fops.c:127>, pid 17288: entering op=4008a105 arg=0x3
    cr_phase1_register <cr_async.c:145>, pid 17288: entering 
    __cr_task_get <cr_task.c:98>, pid 17288: Alloc cr_task_t 00000102a44cee20 for pid 17288
    ctrl_ioctl <cr_fops.c:127>, pid 17288: entering op=c008a106 arg=0x0
    cr_suspend <cr_async.c:79>, pid 17288: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17266: entering op=4008a120 arg=0x7fbffff210
    cr_rstrt_request_restart <cr_rstrt_req.c:765>, pid 17266: entering 
    alloc_rstrt_req <cr_rstrt_req.c:71>, pid 17266: Alloc cr_rstrt_req_t 000001043e2d0e80
    cr_loc_init <cr_dest_file.c:158>, pid 17266: Calling do_init_reg on fd 4
    cr_rstrt_request_restart <cr_rstrt_req.c:826>, pid 17266: cr_magic = 67 82, cr_version = 7, scope = 0, arch = 5.
    ctrl_ioctl <cr_fops.c:127>, pid 17266: entering op=8008a126 arg=0x7fbfffec50
    cr_rstrt_procs <cr_rstrt_req.c:876>, pid 17266: entering 
    cr_rstrt_procs <cr_rstrt_req.c:1000>, pid 17266: leaving Returning 1
    ctrl_ioctl <cr_fops.c:127>, pid 17289: entering op=0000a123 arg=0xffffffffffffffff
    cr_rstrt_child <cr_rstrt_req.c:2478>, pid 17289: entering 
    __cr_task_get <cr_task.c:98>, pid 17289: Alloc cr_task_t 00000102f26399c8 for pid 17289
    cr_rstrt_child <cr_rstrt_req.c:2518>, pid 17289: NOTIFY(&proc_req->vmadump_barrier) returning 0
    cr_reserve_ids <cr_rstrt_req.c:501>, pid 17289: Now reserving required ids... 
    cr_reserve_ids <cr_rstrt_req.c:501>, pid 17289: Now reserving required ids... 
    cr_rstrt_child <cr_rstrt_req.c:2586>, pid 17289: 17289: Restoring credentials
    ctrl_ioctl <cr_fops.c:127>, pid 17266: entering op=8008a126 arg=0x7fbfffec50
    cr_rstrt_procs <cr_rstrt_req.c:876>, pid 17266: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17290: entering op=0000a123 arg=0xffffffffffffffff
    cr_rstrt_child <cr_rstrt_req.c:2478>, pid 17290: entering 
    __cr_task_get <cr_task.c:98>, pid 17290: Alloc cr_task_t 00000102a44cecd0 for pid 17290
    cr_rstrt_child <cr_rstrt_req.c:2518>, pid 17290: NOTIFY(&proc_req->vmadump_barrier) returning 1
    cr_rstrt_child <cr_rstrt_req.c:2659>, pid 17289: Formerly lt-hooks PID 17252
    cr_restore_pids <cr_rstrt_req.c:1379>, pid 17289: ENTER_INTERRUPTIBLE(&proc_req->linkage_barrier)
    cr_rstrt_child <cr_rstrt_req.c:2659>, pid 17290: Formerly lt-hooks PID 17265
    cr_restore_pids <cr_rstrt_req.c:1363>, pid 17290: Now restoring the pids... 
    cr_restore_pids <cr_rstrt_req.c:1370>, pid 17265: Linkage restore finished...
    cr_restore_pids <cr_rstrt_req.c:1379>, pid 17265: ENTER_INTERRUPTIBLE(&proc_req->linkage_barrier)
    cr_restore_pids <cr_rstrt_req.c:1379>, pid 17265: LEAVE(&proc_req->linkage_barrier) returning 1
    cr_restore_pids <cr_rstrt_req.c:1379>, pid 17252: LEAVE(&proc_req->linkage_barrier) returning 0
    cr_rstrt_child <cr_rstrt_req.c:2707>, pid 17265: 17265: loading mmap()s table
    cr_rstrt_child <cr_rstrt_req.c:2720>, pid 17265: Reading POSIX interval timers...
    cr_restore_all_files <cr_rstrt_req.c:2017>, pid 17265: close-on-exec of callers files
    cr_restore_all_files <cr_rstrt_req.c:2031>, pid 17265: recovering fs_struct...
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17265: entering 
    cr_restore_all_files <cr_rstrt_req.c:2062>, pid 17265:    fd=0 dnr=1
    cr_restore_open_chr <cr_rstrt_req.c:1752>, pid 17265: entering 
    cr_restore_open_chr <cr_rstrt_req.c:1809>, pid 17265:    Character device.  major=5, minor=0 path='/dev/tty'
    cr_restore_file_locks <cr_rstrt_req.c:1969>, pid 17265: entering 
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17265: entering 
    cr_restore_all_files <cr_rstrt_req.c:2062>, pid 17265:    fd=1 dnr=1
    cr_restore_open_dup <cr_rstrt_req.c:1886>, pid 17265: entering 
    cr_restore_open_dup <cr_rstrt_req.c:1912>, pid 17265: cr_dup2(000001065b4f6380 -> 1) successful
    cr_restore_file_locks <cr_rstrt_req.c:1969>, pid 17265: entering 
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17265: entering 
    cr_restore_all_files <cr_rstrt_req.c:2062>, pid 17265:    fd=2 dnr=1
    cr_restore_open_dup <cr_rstrt_req.c:1886>, pid 17265: entering 
    cr_restore_open_dup <cr_rstrt_req.c:1912>, pid 17265: cr_dup2(000001065b4f6380 -> 2) successful
    cr_restore_file_locks <cr_rstrt_req.c:1969>, pid 17265: entering 
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17265: entering 
    cr_restore_all_files <cr_rstrt_req.c:2062>, pid 17265:    fd=3 dnr=0
    cr_restore_open_file <cr_rstrt_req.c:1548>, pid 17265: entering 
    ctrl_open <cr_fops.c:225>, pid 17265: entering 
    cr_restore_file_locks <cr_rstrt_req.c:1969>, pid 17265: entering 
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17265: entering 
    cr_restore_all_files <cr_rstrt_req.c:2062>, pid 17265:    fd=5 dnr=0
    cr_restore_open_chkpt_req <cr_rstrt_req.c:1927>, pid 17265: entering 
    cr_restore_open_file <cr_rstrt_req.c:1548>, pid 17265: entering 
    ctrl_open <cr_fops.c:225>, pid 17265: entering 
    cr_restore_file_locks <cr_rstrt_req.c:1969>, pid 17265: entering 
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17265: entering 
    cr_end_of_file_restore <cr_rstrt_req.c:1957>, pid 17265: entering 
    cr_finish_all_file_restores <cr_rstrt_req.c:1982>, pid 17265: entering 
    cr_finish_all_file_restores <cr_rstrt_req.c:1985>, pid 17265: current->files=000001001dbe9c00
    cr_finish_all_file_restores <cr_rstrt_req.c:1990>, pid 17265: fd=0 filp=000001065b4f6380 filp->dentry=0000010113566268 d_count=2 d_inode=0000010666433d88
    cr_finish_all_file_restores <cr_rstrt_req.c:1990>, pid 17265: fd=1 filp=000001065b4f6380 filp->dentry=0000010113566268 d_count=2 d_inode=0000010666433d88
    cr_finish_all_file_restores <cr_rstrt_req.c:1990>, pid 17265: fd=2 filp=000001065b4f6380 filp->dentry=0000010113566268 d_count=2 d_inode=0000010666433d88
    cr_finish_all_file_restores <cr_rstrt_req.c:1990>, pid 17265: fd=3 filp=00000101a711ae80 filp->dentry=00000106681d59a8 d_count=4 d_inode=0000010397f5e7a0
    cr_finish_all_file_restores <cr_rstrt_req.c:1990>, pid 17265: fd=5 filp=00000106085e77c0 filp->dentry=00000106681d59a8 d_count=4 d_inode=0000010397f5e7a0
    cr_rstrt_child <cr_rstrt_req.c:2759>, pid 17265: 17265: closing request descriptor
    cr_rstrt_child <cr_rstrt_req.c:2770>, pid 17265: 17265: closing context file descriptor
    cr_rstrt_child <cr_rstrt_req.c:2826>, pid 17265: NOTIFY(&req->barrier) returning 0
    cr_rstrt_child <cr_rstrt_req.c:2826>, pid 17252: NOTIFY(&req->barrier) returning 0
    cr_restore_parents <cr_rstrt_req.c:676>, pid 17266: Now restoring the parent linkage... 
    cr_rstrt_procs <cr_rstrt_req.c:997>, pid 17266: NOTIFY(&req->barrier) returning 1
    cr_rstrt_procs <cr_rstrt_req.c:1000>, pid 17266: leaving Returning 0
    ctrl_ioctl <cr_fops.c:127>, pid 17266: entering op=c008a121 arg=0x0
    cr_rstrt_done <cr_rstrt_req.c:1052>, pid 17266: entering 
    cr_rstrt_child <cr_rstrt_req.c:2846>, pid 17252: leaving Returning 17266
    ctrl_ioctl <cr_fops.c:127>, pid 17252: entering op=4008a108 arg=0xffffffffffffffff
    cr_hand_complete <cr_fops.c:42>, pid 17252: entering 
    cr_signal_rstrt_complete_barrier <cr_rstrt_req.c:2282>, pid 17252: ENTER(&proc_req->pre_complete_barrier)
    cr_rstrt_child <cr_rstrt_req.c:2846>, pid 17265: leaving Returning 17266
    ctrl_ioctl <cr_fops.c:127>, pid 17265: entering op=4008a108 arg=0xffffffffffffffff
    cr_hand_complete <cr_fops.c:42>, pid 17265: entering 
    cr_signal_rstrt_complete_barrier <cr_rstrt_req.c:2282>, pid 17265: ENTER(&proc_req->pre_complete_barrier)
    cr_signal_rstrt_complete_barrier <cr_rstrt_req.c:2282>, pid 17265: LEAVE(&proc_req->pre_complete_barrier) returning 1
    cr_rstrt_task_complete <cr_rstrt_req.c:2447>, pid 17265: ENTER(&proc_req->post_complete_barrier)
    cr_signal_rstrt_complete_barrier <cr_rstrt_req.c:2282>, pid 17252: LEAVE(&proc_req->pre_complete_barrier) returning 0
    cr_rstrt_task_complete <cr_rstrt_req.c:2447>, pid 17252: ENTER(&proc_req->post_complete_barrier)
    cr_rstrt_task_complete <cr_rstrt_req.c:2447>, pid 17252: LEAVE(&proc_req->post_complete_barrier) returning 1
    release_rstrt_req <cr_rstrt_req.c:107>, pid 17252: ref count is approximately 4
    cr_hand_complete <cr_fops.c:66>, pid 17252: leaving Returning 0
    ctrl_ioctl <cr_fops.c:127>, pid 17252: entering op=c008a111 arg=0x0
    cr_chkpt_done <cr_chkpt_req.c:1387>, pid 17252: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17252: entering op=0000a112 arg=0xffffffffffffffff
    ctrl_release <cr_fops.c:240>, pid 17252: entering 
    cr_rstrt_task_complete <cr_rstrt_req.c:2447>, pid 17265: LEAVE(&proc_req->post_complete_barrier) returning 0
    release_rstrt_req <cr_rstrt_req.c:107>, pid 17265: ref count is approximately 3
    cr_hand_complete <cr_fops.c:66>, pid 17265: leaving Returning 0
    release_rstrt_req <cr_rstrt_req.c:107>, pid 17266: ref count is approximately 2
    cr_rstrt_done <cr_rstrt_req.c:1091>, pid 17266: leaving Returning 1
    ctrl_ioctl <cr_fops.c:127>, pid 17266: entering op=0000a122 arg=0xffffffffffffffff
    cr_rstrt_reap <cr_rstrt_req.c:1109>, pid 17266: entering 
    release_rstrt_req <cr_rstrt_req.c:107>, pid 17266: ref count is approximately 1
    release_rstrt_req <cr_rstrt_req.c:127>, pid 17266: Releasing source file
    release_rstrt_req <cr_rstrt_req.c:130>, pid 17266: fput()'ing stdin/out
    release_rstrt_req <cr_rstrt_req.c:133>, pid 17266: put_task_struct(cr_restart_task)
    release_rstrt_req <cr_rstrt_req.c:139>, pid 17266: Free cr_rstrt_req_t 000001043e2d0e80
    cr_rstrt_reap <cr_rstrt_req.c:1125>, pid 17266: leaving Returning 17252
    ctrl_release <cr_fops.c:240>, pid 17265: entering 
    __cr_task_put <cr_task.c:126>, pid 17265: Free cr_task_t 00000102a44cecd0
    __cr_task_put <cr_task.c:126>, pid 17265: Free cr_task_t 00000102f26399c8
    cr_suspend <cr_async.c:117>, pid 17288: leaving with pending signal
    ctrl_release <cr_fops.c:240>, pid 17288: entering 
    __cr_task_put <cr_task.c:126>, pid 17288: Free cr_task_t 00000102a44cee20
    __cr_task_put <cr_task.c:126>, pid 17288: Free cr_task_t 00000102a44cec28
    ctrl_open <cr_fops.c:225>, pid 17291: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17291: entering op=4008a130 arg=0x8
    ctrl_ioctl <cr_fops.c:127>, pid 17291: entering op=4008a107 arg=0x3
    cr_phase2_register <cr_sync.c:73>, pid 17291: entering 
    __cr_task_get <cr_task.c:98>, pid 17291: Alloc cr_task_t 00000102f26399c8 for pid 17291
    ctrl_open <cr_fops.c:225>, pid 17291: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17291: entering op=4008a130 arg=0x8
    ctrl_ioctl <cr_fops.c:127>, pid 17291: entering op=4008a110 arg=0x7fbfffe790
    cr_chkpt_req <cr_chkpt_req.c:856>, pid 17291: entering 
    cr_log_request <cr_chkpt_req.c:834>, pid 17291: checkpointing its own process 17291
    cr_chkpt_req <cr_chkpt_req.c:878>, pid 17291:  checkpoint params:  secs= 0, opts=0000000000000000, fd=4
    alloc_request <cr_chkpt_req.c:254>, pid 17291: Alloc cr_chkpt_req_t 0000010174b64040
    ctrl_open <cr_fops.c:225>, pid 17291: entering 
    cr_loc_init <cr_dest_file.c:158>, pid 17291: Calling do_init_reg on fd 4
    add_proc <cr_chkpt_req.c:562>, pid 17291: Add proc pid=17291
    add_task <cr_chkpt_req.c:436>, pid 17291: entering task=0000010295bea030 (17291)
    add_task <cr_chkpt_req.c:436>, pid 17291: entering task=000001065d9d77f0 (17304)
    __cr_task_get <cr_task.c:98>, pid 17291: Alloc cr_task_t 00000102a44cecd0 for pid 17304
    do_trigger <cr_trigger.c:94>, pid 17291: triggered pid 17291 (lt-hooks) w/ retval=0
    do_trigger <cr_trigger.c:94>, pid 17291: triggered pid 17304 (lt-hooks) w/ retval=0
    ctrl_ioctl <cr_fops.c:127>, pid 17291: entering op=4008a101 arg=0x0
    cr_dump_self <cr_dump_self.c:999>, pid 17291: entering flags=0x0
    cr_dump_self <cr_dump_self.c:1019>, pid 17291: NOTIFY(&req->preshared_barrier) returning 0
    cr_save_file_header <cr_dump_self.c:697>, pid 17291: Dumping file header
    cr_signal_predump_barrier <cr_chkpt_req.c:1151>, pid 17291: ENTER(&proc_req->predump_barrier)
    ctrl_ioctl <cr_fops.c:127>, pid 17304: entering op=4008a101 arg=0x0
    cr_dump_self <cr_dump_self.c:999>, pid 17304: entering flags=0x0
    cr_dump_self <cr_dump_self.c:1019>, pid 17304: NOTIFY(&req->preshared_barrier) returning 1
    cr_signal_predump_barrier <cr_chkpt_req.c:1151>, pid 17304: ENTER(&proc_req->predump_barrier)
    cr_signal_predump_barrier <cr_chkpt_req.c:1151>, pid 17304: LEAVE(&proc_req->predump_barrier) returning 1
    cr_do_vmadump <cr_dump_self.c:777>, pid 17304: Preparing to dump 2 threads of lt-hooks
    cr_save_header <cr_dump_self.c:725>, pid 17304: Dumping header for 2 threads
    cr_signal_predump_barrier <cr_chkpt_req.c:1151>, pid 17291: LEAVE(&proc_req->predump_barrier) returning 0
    cr_do_vmadump <cr_dump_self.c:786>, pid 17304: Writing the per-process linkage.
    cr_do_vmadump <cr_dump_self.c:813>, pid 17304: Writing credentials
    cr_do_vmadump <cr_dump_self.c:854>, pid 17304: Writing vmadump.
    cr_do_vmadump <cr_dump_self.c:854>, pid 17291: Writing vmadump.
    cr_do_vmadump <cr_dump_self.c:865>, pid 17291: thread finished vmadump
    cr_do_vmadump <cr_dump_self.c:870>, pid 17291: ENTER(&proc_req->vmadump_barrier)
    cr_do_vmadump <cr_dump_self.c:865>, pid 17304: thread finished vmadump
    cr_do_vmadump <cr_dump_self.c:870>, pid 17304: ENTER(&proc_req->vmadump_barrier)
    cr_do_vmadump <cr_dump_self.c:870>, pid 17304: LEAVE(&proc_req->vmadump_barrier) returning 1
    cr_do_vmadump <cr_dump_self.c:871>, pid 17304: process finished vmadump
    cr_do_vmadump <cr_dump_self.c:877>, pid 17304: Writing the fs struct...
    cr_do_vmadump <cr_dump_self.c:885>, pid 17304: Writing the mmap()s table (if any)...
    cr_do_vmadump <cr_dump_self.c:894>, pid 17304: Writing POSIX interval timers...
    cr_do_vmadump <cr_dump_self.c:915>, pid 17304: Writing the open file section...
    cr_save_all_files <cr_dump_self.c:556>, pid 17304: entering 
    cr_save_all_files <cr_dump_self.c:559>, pid 17304:     ...files_struct
    cr_save_all_files <cr_dump_self.c:567>, pid 17304:     ...files
    cr_save_all_files <cr_dump_self.c:634>, pid 17304:     ...0 is open character device.
    cr_save_all_files <cr_dump_self.c:642>, pid 17304:     ...1 is dup of 000001065b4f6380
    cr_save_all_files <cr_dump_self.c:642>, pid 17304:     ...2 is dup of 000001065b4f6380
    cr_save_all_files <cr_dump_self.c:614>, pid 17304:     ...3 is regular file.
    cr_save_all_files <cr_dump_self.c:583>, pid 17304: fd 4 is the context file - skipping
    cr_save_all_files <cr_dump_self.c:646>, pid 17304:     ...5 is a checkpoint request.
    cr_do_vmadump <cr_dump_self.c:923>, pid 17304: Writing mmap()ed pages (if any)...
    cr_dump_self <cr_dump_self.c:1114>, pid 17304: ENTER(&req->postdump_barrier)
    cr_do_vmadump <cr_dump_self.c:870>, pid 17291: LEAVE(&proc_req->vmadump_barrier) returning 0
    cr_dump_self <cr_dump_self.c:1114>, pid 17291: ENTER(&req->postdump_barrier)
    cr_dump_self <cr_dump_self.c:1114>, pid 17291: LEAVE(&req->postdump_barrier) returning 1
    cr_dump_self <cr_dump_self.c:1119>, pid 17291: Writing the trailer.
    cr_save_header <cr_dump_self.c:725>, pid 17291: Dumping header for 0 threads
    cr_dump_self <cr_dump_self.c:1151>, pid 17291: leaving Returning 0
    ctrl_ioctl <cr_fops.c:127>, pid 17291: entering op=4008a108 arg=0xffffffffffffffff
    cr_hand_complete <cr_fops.c:42>, pid 17291: entering 
    cr_signal_chkpt_complete_barrier <cr_chkpt_req.c:1182>, pid 17291: ENTER(&proc_req->pre_complete_barrier)
    cr_dump_self <cr_dump_self.c:1114>, pid 17304: LEAVE(&req->postdump_barrier) returning 0
    cr_dump_self <cr_dump_self.c:1151>, pid 17304: leaving Returning 0
    ctrl_ioctl <cr_fops.c:127>, pid 17304: entering op=4008a108 arg=0xffffffffffffffff
    cr_hand_complete <cr_fops.c:42>, pid 17304: entering 
    cr_signal_chkpt_complete_barrier <cr_chkpt_req.c:1182>, pid 17304: ENTER(&proc_req->pre_complete_barrier)
    cr_signal_chkpt_complete_barrier <cr_chkpt_req.c:1182>, pid 17304: LEAVE(&proc_req->pre_complete_barrier) returning 1
    cr_chkpt_task_complete <cr_chkpt_req.c:1310>, pid 17304: ENTER(&proc_req->post_complete_barrier)
    cr_signal_chkpt_complete_barrier <cr_chkpt_req.c:1182>, pid 17291: LEAVE(&proc_req->pre_complete_barrier) returning 0
    cr_chkpt_task_complete <cr_chkpt_req.c:1310>, pid 17291: ENTER(&proc_req->post_complete_barrier)
    cr_chkpt_task_complete <cr_chkpt_req.c:1310>, pid 17291: LEAVE(&proc_req->post_complete_barrier) returning 1
    cr_hand_complete <cr_fops.c:66>, pid 17291: leaving Returning 0
    ctrl_ioctl <cr_fops.c:127>, pid 17291: entering op=c008a111 arg=0x0
    cr_chkpt_done <cr_chkpt_req.c:1387>, pid 17291: entering 
    cr_chkpt_task_complete <cr_chkpt_req.c:1310>, pid 17304: LEAVE(&proc_req->post_complete_barrier) returning 0
    __cr_task_put <cr_task.c:126>, pid 17304: Free cr_task_t 00000102a44cecd0
    cr_hand_complete <cr_fops.c:66>, pid 17304: leaving Returning 0
    cr_chkpt_done <cr_chkpt_req.c:1428>, pid 17291: leaving Returning 1
    ctrl_ioctl <cr_fops.c:127>, pid 17291: entering op=0000a112 arg=0xffffffffffffffff
    ctrl_release <cr_fops.c:240>, pid 17291: entering 
    release_request <cr_chkpt_req.c:52>, pid 17291: Free cr_chkpt_req_t 0000010174b64040
    ctrl_release <cr_fops.c:240>, pid 17291: entering 
    ctrl_release <cr_fops.c:240>, pid 17304: entering 
    __cr_task_put <cr_task.c:126>, pid 17304: Free cr_task_t 00000102f26399c8
    ctrl_open <cr_fops.c:225>, pid 17305: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17305: entering op=4008a130 arg=0x8
    ctrl_ioctl <cr_fops.c:127>, pid 17305: entering op=4008a107 arg=0x3
    cr_phase2_register <cr_sync.c:73>, pid 17305: entering 
    __cr_task_get <cr_task.c:98>, pid 17305: Alloc cr_task_t 00000102f26399c8 for pid 17305
    ctrl_ioctl <cr_fops.c:127>, pid 17327: entering op=4008a105 arg=0x3
    cr_phase1_register <cr_async.c:145>, pid 17327: entering 
    __cr_task_get <cr_task.c:98>, pid 17327: Alloc cr_task_t 00000102a44cecd0 for pid 17327
    ctrl_ioctl <cr_fops.c:127>, pid 17327: entering op=c008a106 arg=0x0
    cr_suspend <cr_async.c:79>, pid 17327: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17305: entering op=4008a120 arg=0x7fbffff210
    cr_rstrt_request_restart <cr_rstrt_req.c:765>, pid 17305: entering 
    alloc_rstrt_req <cr_rstrt_req.c:71>, pid 17305: Alloc cr_rstrt_req_t 000001043e2d0e80
    cr_loc_init <cr_dest_file.c:158>, pid 17305: Calling do_init_reg on fd 4
    cr_rstrt_request_restart <cr_rstrt_req.c:826>, pid 17305: cr_magic = 67 82, cr_version = 7, scope = 0, arch = 5.
    ctrl_ioctl <cr_fops.c:127>, pid 17305: entering op=8008a126 arg=0x7fbfffec50
    cr_rstrt_procs <cr_rstrt_req.c:876>, pid 17305: entering 
    cr_rstrt_procs <cr_rstrt_req.c:1000>, pid 17305: leaving Returning 1
    ctrl_ioctl <cr_fops.c:127>, pid 17305: entering op=8008a126 arg=0x7fbfffec50
    cr_rstrt_procs <cr_rstrt_req.c:876>, pid 17305: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17329: entering op=0000a123 arg=0xffffffffffffffff
    cr_rstrt_child <cr_rstrt_req.c:2478>, pid 17329: entering 
    __cr_task_get <cr_task.c:98>, pid 17329: Alloc cr_task_t 00000102f2639140 for pid 17329
    cr_rstrt_child <cr_rstrt_req.c:2518>, pid 17329: NOTIFY(&proc_req->vmadump_barrier) returning 0
    cr_reserve_ids <cr_rstrt_req.c:501>, pid 17329: Now reserving required ids... 
    cr_reserve_ids <cr_rstrt_req.c:501>, pid 17329: Now reserving required ids... 
    cr_rstrt_child <cr_rstrt_req.c:2586>, pid 17329: 17329: Restoring credentials
    ctrl_ioctl <cr_fops.c:127>, pid 17328: entering op=0000a123 arg=0xffffffffffffffff
    cr_rstrt_child <cr_rstrt_req.c:2478>, pid 17328: entering 
    __cr_task_get <cr_task.c:98>, pid 17328: Alloc cr_task_t 00000102a44ced78 for pid 17328
    cr_rstrt_child <cr_rstrt_req.c:2518>, pid 17328: NOTIFY(&proc_req->vmadump_barrier) returning 1
    cr_rstrt_child <cr_rstrt_req.c:2659>, pid 17328: Formerly lt-hooks PID 17291
    cr_restore_pids <cr_rstrt_req.c:1379>, pid 17328: ENTER_INTERRUPTIBLE(&proc_req->linkage_barrier)
    cr_rstrt_child <cr_rstrt_req.c:2659>, pid 17329: Formerly lt-hooks PID 17304
    cr_restore_pids <cr_rstrt_req.c:1363>, pid 17329: Now restoring the pids... 
    cr_restore_pids <cr_rstrt_req.c:1370>, pid 17304: Linkage restore finished...
    cr_restore_pids <cr_rstrt_req.c:1379>, pid 17304: ENTER_INTERRUPTIBLE(&proc_req->linkage_barrier)
    cr_restore_pids <cr_rstrt_req.c:1379>, pid 17304: LEAVE(&proc_req->linkage_barrier) returning 1
    cr_restore_pids <cr_rstrt_req.c:1379>, pid 17291: LEAVE(&proc_req->linkage_barrier) returning 0
    cr_rstrt_child <cr_rstrt_req.c:2707>, pid 17304: 17304: loading mmap()s table
    cr_rstrt_child <cr_rstrt_req.c:2720>, pid 17304: Reading POSIX interval timers...
    cr_restore_all_files <cr_rstrt_req.c:2017>, pid 17304: close-on-exec of callers files
    cr_restore_all_files <cr_rstrt_req.c:2031>, pid 17304: recovering fs_struct...
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17304: entering 
    cr_restore_all_files <cr_rstrt_req.c:2062>, pid 17304:    fd=0 dnr=1
    cr_restore_open_chr <cr_rstrt_req.c:1752>, pid 17304: entering 
    cr_restore_open_chr <cr_rstrt_req.c:1809>, pid 17304:    Character device.  major=5, minor=0 path='/dev/tty'
    cr_restore_file_locks <cr_rstrt_req.c:1969>, pid 17304: entering 
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17304: entering 
    cr_restore_all_files <cr_rstrt_req.c:2062>, pid 17304:    fd=1 dnr=1
    cr_restore_open_dup <cr_rstrt_req.c:1886>, pid 17304: entering 
    cr_restore_open_dup <cr_rstrt_req.c:1912>, pid 17304: cr_dup2(000001065b4f6380 -> 1) successful
    cr_restore_file_locks <cr_rstrt_req.c:1969>, pid 17304: entering 
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17304: entering 
    cr_restore_all_files <cr_rstrt_req.c:2062>, pid 17304:    fd=2 dnr=1
    cr_restore_open_dup <cr_rstrt_req.c:1886>, pid 17304: entering 
    cr_restore_open_dup <cr_rstrt_req.c:1912>, pid 17304: cr_dup2(000001065b4f6380 -> 2) successful
    cr_restore_file_locks <cr_rstrt_req.c:1969>, pid 17304: entering 
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17304: entering 
    cr_restore_all_files <cr_rstrt_req.c:2062>, pid 17304:    fd=3 dnr=0
    cr_restore_open_file <cr_rstrt_req.c:1548>, pid 17304: entering 
    ctrl_open <cr_fops.c:225>, pid 17304: entering 
    cr_restore_file_locks <cr_rstrt_req.c:1969>, pid 17304: entering 
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17304: entering 
    cr_restore_all_files <cr_rstrt_req.c:2062>, pid 17304:    fd=5 dnr=0
    cr_restore_open_chkpt_req <cr_rstrt_req.c:1927>, pid 17304: entering 
    cr_restore_open_file <cr_rstrt_req.c:1548>, pid 17304: entering 
    ctrl_open <cr_fops.c:225>, pid 17304: entering 
    cr_restore_file_locks <cr_rstrt_req.c:1969>, pid 17304: entering 
    cr_load_file_info <cr_rstrt_req.c:1451>, pid 17304: entering 
    cr_end_of_file_restore <cr_rstrt_req.c:1957>, pid 17304: entering 
    cr_finish_all_file_restores <cr_rstrt_req.c:1982>, pid 17304: entering 
    cr_finish_all_file_restores <cr_rstrt_req.c:1985>, pid 17304: current->files=0000010667e34180
    cr_finish_all_file_restores <cr_rstrt_req.c:1990>, pid 17304: fd=0 filp=000001065b4f6380 filp->dentry=0000010113566268 d_count=2 d_inode=0000010666433d88
    cr_finish_all_file_restores <cr_rstrt_req.c:1990>, pid 17304: fd=1 filp=000001065b4f6380 filp->dentry=0000010113566268 d_count=2 d_inode=0000010666433d88
    cr_finish_all_file_restores <cr_rstrt_req.c:1990>, pid 17304: fd=2 filp=000001065b4f6380 filp->dentry=0000010113566268 d_count=2 d_inode=0000010666433d88
    cr_finish_all_file_restores <cr_rstrt_req.c:1990>, pid 17304: fd=3 filp=00000103f0b43dc0 filp->dentry=00000106681d59a8 d_count=4 d_inode=0000010397f5e7a0
    cr_finish_all_file_restores <cr_rstrt_req.c:1990>, pid 17304: fd=5 filp=0000010612aba580 filp->dentry=00000106681d59a8 d_count=4 d_inode=0000010397f5e7a0
    cr_rstrt_child <cr_rstrt_req.c:2759>, pid 17304: 17304: closing request descriptor
    cr_rstrt_child <cr_rstrt_req.c:2770>, pid 17304: 17304: closing context file descriptor
    cr_rstrt_child <cr_rstrt_req.c:2826>, pid 17304: NOTIFY(&req->barrier) returning 0
    cr_rstrt_child <cr_rstrt_req.c:2826>, pid 17291: NOTIFY(&req->barrier) returning 0
    cr_restore_parents <cr_rstrt_req.c:676>, pid 17305: Now restoring the parent linkage... 
    cr_rstrt_procs <cr_rstrt_req.c:997>, pid 17305: NOTIFY(&req->barrier) returning 1
    cr_rstrt_procs <cr_rstrt_req.c:1000>, pid 17305: leaving Returning 0
    ctrl_ioctl <cr_fops.c:127>, pid 17305: entering op=c008a121 arg=0x0
    cr_rstrt_done <cr_rstrt_req.c:1052>, pid 17305: entering 
    cr_rstrt_child <cr_rstrt_req.c:2846>, pid 17291: leaving Returning 17305
    ctrl_ioctl <cr_fops.c:127>, pid 17291: entering op=4008a108 arg=0xffffffffffffffff
    cr_hand_complete <cr_fops.c:42>, pid 17291: entering 
    cr_signal_rstrt_complete_barrier <cr_rstrt_req.c:2282>, pid 17291: ENTER(&proc_req->pre_complete_barrier)
    cr_rstrt_child <cr_rstrt_req.c:2846>, pid 17304: leaving Returning 17305
    ctrl_ioctl <cr_fops.c:127>, pid 17304: entering op=4008a108 arg=0xffffffffffffffff
    cr_hand_complete <cr_fops.c:42>, pid 17304: entering 
    cr_signal_rstrt_complete_barrier <cr_rstrt_req.c:2282>, pid 17304: ENTER(&proc_req->pre_complete_barrier)
    cr_signal_rstrt_complete_barrier <cr_rstrt_req.c:2282>, pid 17304: LEAVE(&proc_req->pre_complete_barrier) returning 1
    cr_rstrt_task_complete <cr_rstrt_req.c:2447>, pid 17304: ENTER(&proc_req->post_complete_barrier)
    cr_signal_rstrt_complete_barrier <cr_rstrt_req.c:2282>, pid 17291: LEAVE(&proc_req->pre_complete_barrier) returning 0
    cr_rstrt_task_complete <cr_rstrt_req.c:2447>, pid 17291: ENTER(&proc_req->post_complete_barrier)
    cr_rstrt_task_complete <cr_rstrt_req.c:2447>, pid 17291: LEAVE(&proc_req->post_complete_barrier) returning 1
    release_rstrt_req <cr_rstrt_req.c:107>, pid 17291: ref count is approximately 4
    cr_hand_complete <cr_fops.c:66>, pid 17291: leaving Returning 0
    ctrl_ioctl <cr_fops.c:127>, pid 17291: entering op=c008a111 arg=0x0
    cr_chkpt_done <cr_chkpt_req.c:1387>, pid 17291: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17291: entering op=0000a112 arg=0xffffffffffffffff
    ctrl_release <cr_fops.c:240>, pid 17291: entering 
    cr_rstrt_task_complete <cr_rstrt_req.c:2447>, pid 17304: LEAVE(&proc_req->post_complete_barrier) returning 0
    release_rstrt_req <cr_rstrt_req.c:107>, pid 17304: ref count is approximately 3
    __cr_task_put <cr_task.c:126>, pid 17304: Free cr_task_t 00000102f2639140
    cr_hand_complete <cr_fops.c:66>, pid 17304: leaving Returning 0
    release_rstrt_req <cr_rstrt_req.c:107>, pid 17305: ref count is approximately 2
    cr_rstrt_done <cr_rstrt_req.c:1091>, pid 17305: leaving Returning 1
    ctrl_ioctl <cr_fops.c:127>, pid 17305: entering op=0000a122 arg=0xffffffffffffffff
    cr_rstrt_reap <cr_rstrt_req.c:1109>, pid 17305: entering 
    release_rstrt_req <cr_rstrt_req.c:107>, pid 17305: ref count is approximately 1
    release_rstrt_req <cr_rstrt_req.c:127>, pid 17305: Releasing source file
    release_rstrt_req <cr_rstrt_req.c:130>, pid 17305: fput()'ing stdin/out
    release_rstrt_req <cr_rstrt_req.c:133>, pid 17305: put_task_struct(cr_restart_task)
    release_rstrt_req <cr_rstrt_req.c:139>, pid 17305: Free cr_rstrt_req_t 000001043e2d0e80
    cr_rstrt_reap <cr_rstrt_req.c:1125>, pid 17305: leaving Returning 17291
    ctrl_release <cr_fops.c:240>, pid 17291: entering 
    __cr_task_put <cr_task.c:126>, pid 17291: Free cr_task_t 00000102a44ced78
    cr_suspend <cr_async.c:117>, pid 17327: leaving with pending signal
    ctrl_release <cr_fops.c:240>, pid 17327: entering 
    __cr_task_put <cr_task.c:126>, pid 17327: Free cr_task_t 00000102a44cecd0
    __cr_task_put <cr_task.c:126>, pid 17327: Free cr_task_t 00000102f26399c8
    ctrl_release <cr_fops.c:240>, pid 10: entering 
    release_request <cr_chkpt_req.c:52>, pid 10: Free cr_chkpt_req_t 0000010174b64e50
    ctrl_open <cr_fops.c:225>, pid 18480: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 18480: entering op=4008a130 arg=0x8
    ctrl_ioctl <cr_fops.c:127>, pid 18480: entering op=4008a107 arg=0x4
    cr_phase2_register <cr_sync.c:73>, pid 18480: entering 
    __cr_task_get <cr_task.c:98>, pid 18480: Alloc cr_task_t 000001057b6c3a30 for pid 18480
    ctrl_ioctl <cr_fops.c:127>, pid 18481: entering op=4008a105 arg=0x4
    cr_phase1_register <cr_async.c:145>, pid 18481: entering 
    __cr_task_get <cr_task.c:98>, pid 18481: Alloc cr_task_t 000001057b6c3988 for pid 18481
    ctrl_ioctl <cr_fops.c:127>, pid 18481: entering op=c008a106 arg=0x0
    cr_suspend <cr_async.c:79>, pid 18481: entering 
    ctrl_open <cr_fops.c:225>, pid 18480: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 18480: entering op=4008a130 arg=0x8
    ctrl_ioctl <cr_fops.c:127>, pid 18480: entering op=4008a110 arg=0x7fbfffeae0
    cr_chkpt_req <cr_chkpt_req.c:856>, pid 18480: entering 
    cr_log_request <cr_chkpt_req.c:830>, pid 18480: checkpointing process 17371 with signal 9
    cr_chkpt_req <cr_chkpt_req.c:878>, pid 18480:  checkpoint params:  secs= 0, opts=0000000000000000, fd=3
    alloc_request <cr_chkpt_req.c:254>, pid 18480: Alloc cr_chkpt_req_t 000001002616ce50
    ctrl_open <cr_fops.c:225>, pid 18480: entering 
    cr_loc_init <cr_dest_file.c:158>, pid 18480: Calling do_init_reg on fd 3
    add_proc <cr_chkpt_req.c:562>, pid 18480: Add proc pid=17371
    add_task <cr_chkpt_req.c:436>, pid 18480: entering task=0000010395d977f0 (17371)
    __cr_task_get <cr_task.c:98>, pid 18480: Alloc cr_task_t 000001057b6c38e0 for pid 17371
    do_trigger <cr_trigger.c:94>, pid 18480: triggered pid 17371 (crvelsyn) w/ retval=0
    ctrl_ioctl <cr_fops.c:127>, pid 18480: entering op=c008a111 arg=0x0
    cr_chkpt_done <cr_chkpt_req.c:1387>, pid 18480: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 17371: entering op=4008a101 arg=0x0
    cr_dump_self <cr_dump_self.c:999>, pid 17371: entering flags=0x0
    cr_dump_self <cr_dump_self.c:1019>, pid 17371: NOTIFY(&req->preshared_barrier) returning 1
    cr_save_file_header <cr_dump_self.c:697>, pid 17371: Dumping file header
    cr_signal_predump_barrier <cr_chkpt_req.c:1151>, pid 17371: ENTER(&proc_req->predump_barrier)
    cr_signal_predump_barrier <cr_chkpt_req.c:1151>, pid 17371: LEAVE(&proc_req->predump_barrier) returning 1
    cr_do_vmadump <cr_dump_self.c:777>, pid 17371: Preparing to dump 1 threads of crvelsyn
    cr_save_header <cr_dump_self.c:725>, pid 17371: Dumping header for 1 threads
    cr_do_vmadump <cr_dump_self.c:786>, pid 17371: Writing the per-process linkage.
    cr_do_vmadump <cr_dump_self.c:813>, pid 17371: Writing credentials
    cr_do_vmadump <cr_dump_self.c:854>, pid 17371: Writing vmadump.
    cr_do_vmadump <cr_dump_self.c:865>, pid 17371: thread finished vmadump
    cr_do_vmadump <cr_dump_self.c:870>, pid 17371: ENTER(&proc_req->vmadump_barrier)
    cr_do_vmadump <cr_dump_self.c:870>, pid 17371: LEAVE(&proc_req->vmadump_barrier) returning 1
    cr_do_vmadump <cr_dump_self.c:871>, pid 17371: process finished vmadump
    cr_do_vmadump <cr_dump_self.c:877>, pid 17371: Writing the fs struct...
    cr_do_vmadump <cr_dump_self.c:885>, pid 17371: Writing the mmap()s table (if any)...
    cr_do_vmadump <cr_dump_self.c:894>, pid 17371: Writing POSIX interval timers...
    cr_do_vmadump <cr_dump_self.c:915>, pid 17371: Writing the open file section...
    cr_save_all_files <cr_dump_self.c:556>, pid 17371: entering 
    cr_save_all_files <cr_dump_self.c:559>, pid 17371:     ...files_struct
    cr_save_all_files <cr_dump_self.c:567>, pid 17371:     ...files
    cr_save_all_files <cr_dump_self.c:634>, pid 17371:     ...0 is open character device.
    cr_save_all_files <cr_dump_self.c:642>, pid 17371:     ...1 is dup of 000001065ca6d580
    cr_save_all_files <cr_dump_self.c:642>, pid 17371:     ...2 is dup of 000001065ca6d580
    cr_save_all_files <cr_dump_self.c:634>, pid 17371:     ...3 is open character device.
    cr_save_all_files <cr_dump_self.c:614>, pid 17371:     ...4 is regular file.
    cr_save_all_files <cr_dump_self.c:614>, pid 17371:     ...5 is regular file.
    cr_save_all_files <cr_dump_self.c:614>, pid 17371:     ...6 is regular file.
    cr_save_all_files <cr_dump_self.c:614>, pid 17371:     ...7 is regular file.
    cr_save_all_files <cr_dump_self.c:614>, pid 17371:     ...8 is regular file.
    cr_save_all_files <cr_dump_self.c:614>, pid 17371:     ...9 is regular file.
    cr_save_all_files <cr_dump_self.c:614>, pid 17371:     ...10 is regular file.
    cr_save_all_files <cr_dump_self.c:614>, pid 17371:     ...11 is regular file.
    cr_save_all_files <cr_dump_self.c:614>, pid 17371:     ...12 is regular file.
    cr_save_all_files <cr_dump_self.c:614>, pid 17371:     ...13 is regular file.
    cr_save_all_files <cr_dump_self.c:614>, pid 17371:     ...14 is regular file.
    cr_save_all_files <cr_dump_self.c:614>, pid 17371:     ...15 is regular file.
    cr_save_all_files <cr_dump_self.c:614>, pid 17371:     ...16 is regular file.
    cr_save_all_files <cr_dump_self.c:614>, pid 17371:     ...17 is regular file.
    cr_save_all_files <cr_dump_self.c:614>, pid 17371:     ...18 is regular file.
    cr_save_all_files <cr_dump_self.c:614>, pid 17371:     ...19 is regular file.
    cr_save_all_files <cr_dump_self.c:614>, pid 17371:     ...20 is regular file.
    cr_do_vmadump <cr_dump_self.c:923>, pid 17371: Writing mmap()ed pages (if any)...
    cr_dump_self <cr_dump_self.c:1114>, pid 17371: ENTER(&req->postdump_barrier)
    cr_dump_self <cr_dump_self.c:1114>, pid 17371: LEAVE(&req->postdump_barrier) returning 1
    cr_dump_self <cr_dump_self.c:1119>, pid 17371: Writing the trailer.
    cr_save_header <cr_dump_self.c:725>, pid 17371: Dumping header for 0 threads
    cr_dump_self <cr_dump_self.c:1151>, pid 17371: leaving Returning 0
    ctrl_ioctl <cr_fops.c:127>, pid 17371: entering op=4008a108 arg=0xffffffffffffffff
    cr_hand_complete <cr_fops.c:42>, pid 17371: entering 
    cr_signal_chkpt_complete_barrier <cr_chkpt_req.c:1182>, pid 17371: ENTER(&proc_req->pre_complete_barrier)
    cr_signal_chkpt_complete_barrier <cr_chkpt_req.c:1182>, pid 17371: LEAVE(&proc_req->pre_complete_barrier) returning 1
    cr_chkpt_task_complete <cr_chkpt_req.c:1310>, pid 17371: ENTER(&proc_req->post_complete_barrier)
    cr_chkpt_task_complete <cr_chkpt_req.c:1310>, pid 17371: LEAVE(&proc_req->post_complete_barrier) returning 1
    __cr_task_put <cr_task.c:126>, pid 17371: Free cr_task_t 000001057b6c38e0
    cr_hand_complete <cr_fops.c:66>, pid 17371: leaving Returning 0
    cr_chkpt_done <cr_chkpt_req.c:1428>, pid 18480: leaving Returning 1
    ctrl_ioctl <cr_fops.c:127>, pid 18480: entering op=0000a112 arg=0xffffffffffffffff
    ctrl_release <cr_fops.c:240>, pid 18480: entering 
    release_request <cr_chkpt_req.c:52>, pid 18480: Free cr_chkpt_req_t 000001002616ce50
    ctrl_release <cr_fops.c:240>, pid 18480: entering 
    cr_suspend <cr_async.c:117>, pid 18481: leaving with pending signal
    ctrl_release <cr_fops.c:240>, pid 18481: entering 
    __cr_task_put <cr_task.c:126>, pid 18481: Free cr_task_t 000001057b6c3988
    __cr_task_put <cr_task.c:126>, pid 18481: Free cr_task_t 000001057b6c3a30
    ctrl_open <cr_fops.c:225>, pid 20297: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 20297: entering op=4008a130 arg=0x8
    ctrl_ioctl <cr_fops.c:127>, pid 20297: entering op=4008a107 arg=0x3
    cr_phase2_register <cr_sync.c:73>, pid 20297: entering 
    __cr_task_get <cr_task.c:98>, pid 20297: Alloc cr_task_t 0000010306f19a70 for pid 20297
    ctrl_ioctl <cr_fops.c:127>, pid 20298: entering op=4008a105 arg=0x3
    cr_phase1_register <cr_async.c:145>, pid 20298: entering 
    __cr_task_get <cr_task.c:98>, pid 20298: Alloc cr_task_t 0000010306f199c8 for pid 20298
    ctrl_ioctl <cr_fops.c:127>, pid 20298: entering op=c008a106 arg=0x0
    cr_suspend <cr_async.c:79>, pid 20298: entering 
    ctrl_ioctl <cr_fops.c:127>, pid 20297: entering op=4008a120 arg=0x7fbffff2b0
    cr_rstrt_request_restart <cr_rstrt_req.c:765>, pid 20297: entering 
    alloc_rstrt_req <cr_rstrt_req.c:71>, pid 20297: Alloc cr_rstrt_req_t 000001019de52e80
    cr_loc_init <cr_dest_file.c:158>, pid 20297: Calling do_init_reg on fd 4
    cr_rstrt_request_restart <cr_rstrt_req.c:826>, pid 20297: cr_magic = 67 82, cr_version = 7, scope = 0, arch = 5.
    ctrl_ioctl <cr_fops.c:127>, pid 20297: entering op=8008a126 arg=0x7fbfffecf0
    cr_rstrt_procs <cr_rstrt_req.c:876>, pid 20297: entering 
    cr_rstrt_procs <cr_rstrt_req.c:1000>, pid 20297: leaving Returning 1
    ctrl_ioctl <cr_fops.c:127>, pid 20299: entering op=0000a123 arg=0xffffffffffffffff
    cr_rstrt_child <cr_rstrt_req.c:2478>, pid 20299: entering 
    __cr_task_get <cr_task.c:98>, pid 20299: Alloc cr_task_t 0000010306f19920 for pid 20299
    cr_rstrt_child <cr_rstrt_req.c:2518>, pid 20299: NOTIFY(&proc_req->vmadump_barrier) returning 1
    cr_reserve_ids <cr_rstrt_req.c:501>, pid 20299: Now reserving required ids... 
    cr_reserve_ids <cr_rstrt_req.c:501>, pid 20299: Now reserving required ids... 
    cr_rstrt_child <cr_rstrt_req.c:2586>, pid 20299: 20299: Restoring credentials
    ctrl_ioctl <cr_fops.c:127>, pid 20297: entering op=8008a126 arg=0x7fbfffecf0
    cr_rstrt_procs <cr_rstrt_req.c:876>, pid 20297: entering 
    blcr: thaw_threads returned error, aborting. -14
    cr_rstrt_child <cr_rstrt_req.c:2623>, pid 20299: NOTIFY(&proc_req->linkage_barrier) returning 1
    cr_rstrt_child <cr_rstrt_req.c:2826>, pid 20299: NOTIFY(&req->barrier) returning 0
    cr_signal_rstrt_complete_barrier <cr_rstrt_req.c:2282>, pid 20299: ENTER(&proc_req->pre_complete_barrier)
    cr_signal_rstrt_complete_barrier <cr_rstrt_req.c:2282>, pid 20299: LEAVE(&proc_req->pre_complete_barrier) returning 1
    cr_rstrt_task_complete <cr_rstrt_req.c:2447>, pid 20299: ENTER(&proc_req->post_complete_barrier)
    cr_rstrt_task_complete <cr_rstrt_req.c:2447>, pid 20299: LEAVE(&proc_req->post_complete_barrier) returning 1
    __cr_task_put <cr_task.c:126>, pid 20299: Free cr_task_t 0000010306f19920
    release_rstrt_req <cr_rstrt_req.c:107>, pid 20299: ref count is approximately 3
    cr_rstrt_child <cr_rstrt_req.c:2846>, pid 20299: leaving Returning 1
    cr_rstrt_procs <cr_rstrt_req.c:997>, pid 20297: NOTIFY(&req->barrier) returning 1
    cr_rstrt_procs <cr_rstrt_req.c:1000>, pid 20297: leaving Returning 0
    ctrl_ioctl <cr_fops.c:127>, pid 20297: entering op=c008a121 arg=0x0
    cr_rstrt_done <cr_rstrt_req.c:1052>, pid 20297: entering 
    release_rstrt_req <cr_rstrt_req.c:107>, pid 20297: ref count is approximately 2
    cr_rstrt_done <cr_rstrt_req.c:1091>, pid 20297: leaving Returning 1
    ctrl_ioctl <cr_fops.c:127>, pid 20297: entering op=0000a122 arg=0xffffffffffffffff
    cr_rstrt_reap <cr_rstrt_req.c:1109>, pid 20297: entering 
    release_rstrt_req <cr_rstrt_req.c:107>, pid 20297: ref count is approximately 1
    release_rstrt_req <cr_rstrt_req.c:127>, pid 20297: Releasing source file
    release_rstrt_req <cr_rstrt_req.c:130>, pid 20297: fput()'ing stdin/out
    release_rstrt_req <cr_rstrt_req.c:133>, pid 20297: put_task_struct(cr_restart_task)
    release_rstrt_req <cr_rstrt_req.c:139>, pid 20297: Free cr_rstrt_req_t 000001019de52e80
    cr_rstrt_reap <cr_rstrt_req.c:1125>, pid 20297: leaving Returning -14
    cr_suspend <cr_async.c:117>, pid 20298: leaving with pending signal
    ctrl_release <cr_fops.c:240>, pid 20299: entering 
    __cr_task_put <cr_task.c:126>, pid 20299: Free cr_task_t 0000010306f199c8
    __cr_task_put <cr_task.c:126>, pid 20299: Free cr_task_t 0000010306f19a70
    

  • Next message: Paul H. Hargrove: "Re: Error from re-start on very large context file"