vhil/helpfulcore-analytics-index-builder

helpfulcore-analytics-index-builder's Issues

Rebuild issues with visit,visitpage & visitpageevent

Hi vhil,

This is a great tool. We are seeing issues while rebuilding visit, visitpage & visitpageEvent indexes.
Following is the error.
2018-07-26 16:12:32 INFO [AnalyticsIndexBuilder] Error while rebuilding filtered [type:visit] indexables index. An error occurred while deserializing the Pages property of class Sitecore.Analytics.Model.VisitData: An error occurred while deserializing the PageEvents property of class Sitecore.Analytics.Model.PageData: An error occurred while deserializing the CustomValues property of class Sitecore.Analytics.Model.Entity: String cannot have zero length.

Is there any fix for this?

Issue rebuilding indexables

I am getting a lot of errors like this when clicking Rebuild all indexables

2017-08-22 08:49:46.9755 245 ERROR [AnalyticsSearchService]: Error while Updating 1000 indexables in 'sitecore_analytics_index'. Unable to cast object of type 'Sitecore.ContentSearch.LuceneProvider.LuceneDocumentBuilder' to type 'Sitecore.ContentSearch.AbstractDocumentBuilder1[System.Collections.Concurrent.ConcurrentDictionary2[System.String,System.Object]]'.System.InvalidCastException: Unable to cast object of type 'Sitecore.ContentSearch.LuceneProvider.LuceneDocumentBuilder' to type 'Sitecore.ContentSearch.AbstractDocumentBuilder1[System.Collections.Concurrent.ConcurrentDictionary2[System.String,System.Object]]'. at Helpfulcore.AnalyticsIndexBuilder.ContentSearch.AnalyticsSearchService.BuildIndexableDocument(IIndexable indexable, IProviderUpdateContext context) in C:\Projects\Helpfulcore\helpfulcore-analytics-index-builder\src\Helpfulcore.AnalyticsIndexBuilder\ContentSearch\AnalyticsSearchService.cs:line 133 at Helpfulcore.AnalyticsIndexBuilder.ContentSearch.AnalyticsSearchService.<>c__DisplayClass5_0.<UpdateIndexables>b__0() in C:\Projects\Helpfulcore\helpfulcore-analytics-index-builder\src\Helpfulcore.AnalyticsIndexBuilder\ContentSearch\AnalyticsSearchService.cs:line 64 at Helpfulcore.AnalyticsIndexBuilder.ContentSearch.AnalyticsSearchService.SafeExecution(String actionDescription, Action action, Boolean info) in C:\Projects\Helpfulcore\helpfulcore-analytics-index-builder\src\Helpfulcore.AnalyticsIndexBuilder\ContentSearch\AnalyticsSearchService.cs:line 157

Sitecore 8.2.1
helpfulcore.analyticsindexbuilder.1.2.2
helpfulcore.analyticsindexbuilder.core.1.1.1
helpfulcore.logging.1.0.4

Then if I click Reset analytics index, it gives this error system wide until i recycle the app pool

2017-08-22 09:00:58.6895 176 ERROR [AnalyticsSearchService]: Error while Updating 1000 indexables in 'sitecore_analytics_index'. Cannot access a disposed object. Object name: 'LuceneIndex'.System.ObjectDisposedException: Cannot access a disposed object. Object name: 'LuceneIndex'. at Sitecore.ContentSearch.AbstractSearchIndex.VerifyNotDisposed() at Sitecore.ContentSearch.LuceneProvider.LuceneIndex.EnsureInitialized() at Sitecore.ContentSearch.LuceneProvider.LuceneIndex.CreateUpdateContext() at Helpfulcore.AnalyticsIndexBuilder.ContentSearch.AnalyticsSearchService.<>c__DisplayClass5_0.<UpdateIndexables>b__0() in C:\Projects\Helpfulcore\helpfulcore-analytics-index-builder\src\Helpfulcore.AnalyticsIndexBuilder\ContentSearch\AnalyticsSearchService.cs:line 58 at Helpfulcore.AnalyticsIndexBuilder.ContentSearch.AnalyticsSearchService.SafeExecution(String actionDescription, Action action, Boolean info) in C:\Projects\Helpfulcore\helpfulcore-analytics-index-builder\src\Helpfulcore.AnalyticsIndexBuilder\ContentSearch\AnalyticsSearchService.cs:line 157

Error - While indexing contact

I am getting below error when I am trying to index contacts-

2020-01-28 23:44:25 INFO [AnalyticsIndexBuilder] Error while rebuilding filtered [type:contact] indexables index. An error occurred while deserializing the Owner property of class Sitecore.Analytics.Model.LeaseData: Expected a nested document representing the serialized form of a Sitecore.Analytics.Model.LeaseOwner value, but found a value of type String instead.

Possible memory leak

Hi,
I'm doing a "rebuild all indexes" operation and in an environment with 14Gb RAM and 47.000 contacts with an average of 1 interaction per contacts. each contact is 27KB in Mongo.
I can see that as soon as the process begin the w3wp process start using a lot of memory and processor. It ends up consuming all the memory available until the w3wp dies.
I have done the same several time with the same result. Even tried executing it on a dedicated instance; no difference.
I'm using the default configuration, processing batches of 1.000 and 4 threads.

Performance Issue

Indexing is getting stuck after 1,00,000 contacts records are getting indexed.
Is there any optimization setting we can apply?