[MarkLogic Dev General] rollback && commit problem

[Sanjeev Medishetty]

Skipped content of type multipart/alternative-------------- next part --------------
** REINDEX TO GET TO A BASELINE **

2007-08-01 11:02:57.515 Info: Saving D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\0000002f
2007-08-01 11:03:04.304 Info: Saved 19 MB in 6 sec at 3 MB/sec to D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\0000002f
2007-08-01 11:03:04.705 Info: Merging D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\0000002e and D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\0000002f to D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000031
2007-08-01 11:03:24.243 Info: Saving D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000030
2007-08-01 11:03:24.804 Info: Merged 68 MB in 21 sec at 3 MB/sec to D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000031
2007-08-01 11:03:27.057 Info: Deleted D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\0000002e
2007-08-01 11:03:27.407 Info: Deleted D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\0000002f
2007-08-01 11:03:30.892 Info: Saved 19 MB in 6 sec at 3 MB/sec to D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000030
2007-08-01 11:03:31.283 Info: Merging D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000031 and D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000030 to D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000033
2007-08-01 11:03:39.254 Info: Refragmented 316 fragments in 53 sec at 5 fragments/sec on forest ForestOne
2007-08-01 11:03:52.373 Info: Merged 74 MB in 22 sec at 3 MB/sec to D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000033
2007-08-01 11:03:52.663 Info: Deleted D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000031
2007-08-01 11:03:52.804 Info: Deleted D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000030
2007-08-01 11:03:55.738 Info: Saving D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000032
2007-08-01 11:03:57.560 Info: Saved 13 MB in 1 sec at 13 MB/sec to D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000032
2007-08-01 11:03:57.731 Info: Merging D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000033 and D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000032 to D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000034
2007-08-01 11:04:06.864 Info: Merged 75 MB in 10 sec at 7 MB/sec to D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000034
2007-08-01 11:04:07.154 Info: Deleted D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000033
2007-08-01 11:04:07.294 Info: Deleted D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000032

** SIMPLE SEARCH FOR THE TERM "Hermite" **
(:
let $q2 := cts:word-query("hermite")
return cts:search(fn:doc(),$q2)
:)
Notice second line "8*weight*idf=8*1*log(316/2)=41" indicating idf = log(316/2)
	Is that 316 fragments, with 2 containing the search term -- ??
Notice third line - TF for ".../WCM287.xml"
	"score=scale*logtf=41*3=123" indicating logtf=3 for this fragment
Notice fifth line - TF for ".../WCM280.xml"
	"score=scale*logtf=41*9=369" indicating logtf=9 for this fragment

2007-08-01 11:04:35.104 Info: [Event:id=Relevance Term] key=0xb7543dddd0628c2e text="hermite"
2007-08-01 11:04:35.114 Info: [Event:id=Relevance IDF] key=0xb7543dddd0628c2e scale=8*weight*idf=8*1*log(316/2)=41
2007-08-01 11:04:35.134 Info: [Event:id=Relevance TF] key=0xb7543dddd0628c2e score=scale*logtf=41*3=123 fragment=doc("/content/journals/WCM/WCM287/WCM287.xml")
2007-08-01 11:04:35.134 Info: [Event:id=Relevance Quality] score=scoreSum/weightSum+weight*quality=123/1+1*0=123 confidence=sqrt(score/(8*maxlogtf*maxidf))=sqrt(123/(8*18*log(316)))=0.385231 fitness=sqrt(score/(8*maxlogtf*avgidf))=sqrt(123/(8*18*(5.06259/1)))=0.410757 fragment=doc("/content/journals/WCM/WCM287/WCM287.xml")
2007-08-01 11:04:35.144 Info: [Event:id=Relevance TF] key=0xb7543dddd0628c2e score=scale*logtf=41*9=369 fragment=doc("/content/journals/WCM/WCM280/WCM280.xml")
2007-08-01 11:04:35.144 Info: [Event:id=Relevance Quality] score=scoreSum/weightSum+weight*quality=369/1+1*0=369 confidence=sqrt(score/(8*maxlogtf*maxidf))=sqrt(369/(8*18*log(316)))=0.667239 fitness=sqrt(score/(8*maxlogtf*avgidf))=sqrt(369/(8*18*(5.06259/1)))=0.711452 fragment=doc("/content/journals/WCM/WCM280/WCM280.xml")

** NOW CREATE FIELD "field_sect1" on element "sect1" which contains some of the occurances of the search term **
** ALLOW REINDEXER TO DO ITS THING **

2007-08-01 11:05:54.377 Info: Saving D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000035
2007-08-01 11:06:01.838 Info: Saved 18 MB in 7 sec at 2 MB/sec to D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000035
2007-08-01 11:06:02.519 Info: Merging D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000034 and D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000035 to D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000037
2007-08-01 11:06:16.629 Info: Saving D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000036
2007-08-01 11:06:24.450 Info: Saved 18 MB in 7 sec at 2 MB/sec to D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000036
2007-08-01 11:06:28.466 Info: Merged 54 MB in 26 sec at 2 MB/sec to D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000037
2007-08-01 11:06:29.117 Info: Deleted D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000035
2007-08-01 11:06:29.678 Info: Merging D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000037 and D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000036 to D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000039
2007-08-01 11:06:42.446 Info: Saving D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000038
2007-08-01 11:06:50.167 Info: Saved 19 MB in 7 sec at 2 MB/sec to D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000038
2007-08-01 11:06:55.094 Info: Merged 63 MB in 26 sec at 2 MB/sec to D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000039
2007-08-01 11:06:55.905 Info: Deleted D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000037
2007-08-01 11:06:55.935 Info: Merging D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000039 and D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000038 to D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\0000003b
2007-08-01 11:06:56.135 Info: Deleted D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000036
2007-08-01 11:07:02.695 Info: Refragmented 190 fragments in 79 sec at 2 fragments/sec on forest ForestOne
2007-08-01 11:07:03.506 Info: Deleted D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000034
2007-08-01 11:07:15.633 Info: Merged 70 MB in 20 sec at 3 MB/sec to D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\0000003b
2007-08-01 11:07:16.094 Info: Deleted D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000039
2007-08-01 11:07:16.244 Info: Deleted D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\00000038
2007-08-01 11:07:19.819 Info: Saving D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\0000003a
2007-08-01 11:07:23.144 Info: Saved 18 MB in 3 sec at 6 MB/sec to D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\0000003a
2007-08-01 11:07:23.314 Info: Merging D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\0000003b and D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\0000003a to D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\0000003c

** REPEAT SIMPLE SEARCH FOR THE TERM "Hermite" **
(:
let $q2 := cts:word-query("hermite")
return cts:search(fn:doc(),$q2)
:)
Notice second line "8*weight*idf=8*1*log(508/4)=41" indicating idf = log(508/4)
	Is that 508 fragments, with 4 containing the search term -- ??
	idf has changed from log(316/2)=41 to log(508/4)=39 -- ??
Notice third line - TF for ".../WCM287.xml"
	"score=scale*logtf=39*2=78" indicating logtf=2 for this fragment 
	logtf apparently changed from 3 to 2 -- ??
Notice fifth line - TF for ".../WCM280.xml"
	"score=scale*logtf=39*8=312" indicating logtf=8 for this fragment
	logtf apparently changed from 9 to 8 -- ??

2007-08-01 11:07:36.934 Info: [Event:id=Relevance Term] key=0xb7543dddd0628c2e text="hermite"
2007-08-01 11:07:37.024 Info: [Event:id=Relevance IDF] key=0xb7543dddd0628c2e scale=8*weight*idf=8*1*log(508/4)=39
2007-08-01 11:07:37.044 Info: [Event:id=Relevance TF] key=0xb7543dddd0628c2e score=scale*logtf=39*2=78 fragment=doc("/content/journals/WCM/WCM287/WCM287.xml")
2007-08-01 11:07:37.044 Info: [Event:id=Relevance IDF] key=0xb7543dddd0628c2e scale=8*weight*idf=8*1*log(508/4)=39
2007-08-01 11:07:37.044 Info: [Event:id=Relevance Quality] score=scoreSum/weightSum+weight*quality=78/1+1*0=78 confidence=sqrt(score/(8*maxlogtf*maxidf))=sqrt(78/(8*18*log(508)))=0.294853 fitness=sqrt(score/(8*maxlogtf*avgidf))=sqrt(78/(8*18*(4.84419/1)))=0.334392 fragment=doc("/content/journals/WCM/WCM287/WCM287.xml")
2007-08-01 11:07:37.054 Info: [Event:id=Relevance TF] key=0xb7543dddd0628c2e score=scale*logtf=39*8=312 fragment=doc("/content/journals/WCM/WCM280/WCM280.xml")
2007-08-01 11:07:37.054 Info: [Event:id=Relevance Quality] score=scoreSum/weightSum+weight*quality=312/1+1*0=312 confidence=sqrt(score/(8*maxlogtf*maxidf))=sqrt(312/(8*18*log(508)))=0.589706 fitness=sqrt(score/(8*maxlogtf*avgidf))=sqrt(312/(8*18*(4.84419/1)))=0.668784 fragment=doc("/content/journals/WCM/WCM280/WCM280.xml")

** DROP FIELD field_sect1 **

2007-08-01 11:07:37.474 Info: Merged 76 MB in 15 sec at 5 MB/sec to D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\0000003c
2007-08-01 11:07:37.755 Info: Deleted D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\0000003b
2007-08-01 11:07:37.885 Info: Deleted D:\Documents and Settings\atownsen\MarkLogic\ForestOne\Forests\ForestOne\0000003a


** REPEAT SIMPLE SEARCH FOR THE TERM "Hermite" **
(:
let $q2 := cts:word-query("hermite")
return cts:search(fn:doc(),$q2)
:)
Notice second line "8*weight*idf=8*1*log(316/2)=41" indicating logtf = log(316/2)
	Is that 316 fragments, with 2 containing the search term??
	idf has changed back to log(316/2)=41 after deleting field -- ??
Notice third line - TF for ".../WCM287.xml"
	"score=scale*logtf=41*2=78" indicating logtf=2 for this fragment 
	logtf apparently still 2 
Notice fifth line - TF for ".../WCM280.xml"
	"score=scale*logtf=41*8=312" indicating logtf=8 for this fragment
	logtf apparently still 8

2007-08-01 11:09:06.612 Info: [Event:id=Relevance Term] key=0xb7543dddd0628c2e text="hermite"
2007-08-01 11:09:06.632 Info: [Event:id=Relevance IDF] key=0xb7543dddd0628c2e scale=8*weight*idf=8*1*log(316/2)=41
2007-08-01 11:09:06.632 Info: [Event:id=Relevance TF] key=0xb7543dddd0628c2e score=scale*logtf=41*2=82 fragment=doc("/content/journals/WCM/WCM287/WCM287.xml")
2007-08-01 11:09:06.632 Info: [Event:id=Relevance Quality] score=scoreSum/weightSum+weight*quality=82/1+1*0=82 confidence=sqrt(score/(8*maxlogtf*maxidf))=sqrt(82/(8*18*log(316)))=0.314539 fitness=sqrt(score/(8*maxlogtf*avgidf))=sqrt(82/(8*18*(5.06259/1)))=0.335381 fragment=doc("/content/journals/WCM/WCM287/WCM287.xml")
2007-08-01 11:09:06.632 Info: [Event:id=Relevance TF] key=0xb7543dddd0628c2e score=scale*logtf=41*8=328 fragment=doc("/content/journals/WCM/WCM280/WCM280.xml")
2007-08-01 11:09:06.632 Info: [Event:id=Relevance Quality] score=scoreSum/weightSum+weight*quality=328/1+1*0=328 confidence=sqrt(score/(8*maxlogtf*maxidf))=sqrt(328/(8*18*log(316)))=0.629079 fitness=sqrt(score/(8*maxlogtf*avgidf))=sqrt(328/(8*18*(5.06259/1)))=0.670763 fragment=doc("/content/journals/WCM/WCM280/WCM280.xml")