Decipher Solr error messages

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Decipher Solr error messages

markrthomas
Hello

I'm seeing a number of Solr related issues in my error.log:

2017-06-28 06:02:58.520 [error] <0.2094.0>@yz_doc:extract_fields:165 An exception occurred extracting fields from value with reason {case_clause,<<200,162,171,163,243,217,229,228,195,79,125,154,98,147,163,118,199,52,170,154,85,31,29,208>>}. Value: <<200,162,171,163,243,217,229,228,195,79,125,154,98,147,163,118,199,52,170,154,85,31,29,208>>
2017-06-28 06:02:58.520 [error] <0.2094.0>@yz_solrq_helper:single_op_batch:342 Updating a single Solr operation failed for index <<"disqual">> with bad request.

2017-06-28 06:03:34.191 [error] <0.2103.0>@yz_doc:extract_fields:165 An exception occurred extracting fields from value with reason invalid_utf8. Value: <<"{ \"company\"...........

I think these fall under 2 categories: an issue with the 'disqual' index and 'invalid_utf8'.

Any ideas on identifying where the issues occur?

Thanks

Mark
Equifax Limited is registered in England with Registered No. 2425920. Registered Office: Capital House, 25 Chapel Street, London NW1 5DS. Equifax Limited is authorised and regulated by the Financial Conduct Authority.
Equifax Touchstone Limited is registered in Scotland with Registered No. SC113401. Registered Office: Exchange Tower,19 Canning Street, Edinburgh, EH3 8EH.
Equifax Commercial Services Limited is registered in the Republic of Ireland with Registered No. 215393. Registered Office: IDA Business & Technology Park, Rosslare Road, Drinagh, Wexford.

This message contains information from Equifax which may be confidential and privileged. If you are not an intended recipient, please refrain from any disclosure, copying, distribution or use of this information and note that such actions are prohibited. If you have received this transmission in error, please notify by e-mail [hidden email]<mailto:[hidden email]>.
_______________________________________________
riak-users mailing list
[hidden email]
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Reply | Threaded
Open this post in threaded view
|

Re: Decipher Solr error messages

Fred Dushin-2
My guess is that you have data that is either not UTF-8 encoded or is failing to decode into a JSON payload (peeking quickly at the mochi_json code, there are a lot of case statements, as you would expect in a parser).

There is a call to error logging on line 165 in Riak 2.2.2, so I assume you are on that version of Riak?

-Fred

> On Jun 28, 2017, at 9:11 AM, Mark Richard Thomas <[hidden email]> wrote:
>
> Hello
>
> I'm seeing a number of Solr related issues in my error.log:
>
> 2017-06-28 06:02:58.520 [error] <0.2094.0>@yz_doc:extract_fields:165 An exception occurred extracting fields from value with reason {case_clause,<<200,162,171,163,243,217,229,228,195,79,125,154,98,147,163,118,199,52,170,154,85,31,29,208>>}. Value: <<200,162,171,163,243,217,229,228,195,79,125,154,98,147,163,118,199,52,170,154,85,31,29,208>>
> 2017-06-28 06:02:58.520 [error] <0.2094.0>@yz_solrq_helper:single_op_batch:342 Updating a single Solr operation failed for index <<"disqual">> with bad request.
>
> 2017-06-28 06:03:34.191 [error] <0.2103.0>@yz_doc:extract_fields:165 An exception occurred extracting fields from value with reason invalid_utf8. Value: <<"{ \"company\"...........
>
> I think these fall under 2 categories: an issue with the 'disqual' index and 'invalid_utf8'.
>
> Any ideas on identifying where the issues occur?
>
> Thanks
>
> Mark
> Equifax Limited is registered in England with Registered No. 2425920. Registered Office: Capital House, 25 Chapel Street, London NW1 5DS. Equifax Limited is authorised and regulated by the Financial Conduct Authority.
> Equifax Touchstone Limited is registered in Scotland with Registered No. SC113401. Registered Office: Exchange Tower,19 Canning Street, Edinburgh, EH3 8EH.
> Equifax Commercial Services Limited is registered in the Republic of Ireland with Registered No. 215393. Registered Office: IDA Business & Technology Park, Rosslare Road, Drinagh, Wexford.
>
> This message contains information from Equifax which may be confidential and privileged. If you are not an intended recipient, please refrain from any disclosure, copying, distribution or use of this information and note that such actions are prohibited. If you have received this transmission in error, please notify by e-mail [hidden email]<mailto:[hidden email]>.
> _______________________________________________
> riak-users mailing list
> [hidden email]
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com


_______________________________________________
riak-users mailing list
[hidden email]
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Reply | Threaded
Open this post in threaded view
|

Re: Decipher Solr error messages

Fred Dushin-2
You might be able to query which keys are giving you grief via a query over the `_yz_err` field, as it looks like this field will be populated in this scenario.

export HOST=my-host
export PORT=8098
export INDEX=foo
curl "<a href="http://${host}:${port}/search/query/${INDEX}?q=_yz_err:*&amp;wt=json&amp;indent=t" class="">http://${HOST}:${PORT}/search/query/${INDEX}?q=_yz_err:*&wt=json&indent=true"

And of course you should be able to use the full query language of Solr to return the result set you desire (bucket type, bucket name, key, etc).

-Fred

On Jul 1, 2017, at 10:30 AM, Fred Dushin <[hidden email]> wrote:

My guess is that you have data that is either not UTF-8 encoded or is failing to decode into a JSON payload (peeking quickly at the mochi_json code, there are a lot of case statements, as you would expect in a parser).

There is a call to error logging on line 165 in Riak 2.2.2, so I assume you are on that version of Riak?

-Fred

On Jun 28, 2017, at 9:11 AM, Mark Richard Thomas <[hidden email]> wrote:

Hello

I'm seeing a number of Solr related issues in my error.log:

2017-06-28 06:02:58.520 [error] <0.2094.0>@yz_doc:extract_fields:165 An exception occurred extracting fields from value with reason {case_clause,<<200,162,171,163,243,217,229,228,195,79,125,154,98,147,163,118,199,52,170,154,85,31,29,208>>}. Value: <<200,162,171,163,243,217,229,228,195,79,125,154,98,147,163,118,199,52,170,154,85,31,29,208>>
2017-06-28 06:02:58.520 [error] <0.2094.0>@yz_solrq_helper:single_op_batch:342 Updating a single Solr operation failed for index <<"disqual">> with bad request.

2017-06-28 06:03:34.191 [error] <0.2103.0>@yz_doc:extract_fields:165 An exception occurred extracting fields from value with reason invalid_utf8. Value: <<"{ \"company\"...........

I think these fall under 2 categories: an issue with the 'disqual' index and 'invalid_utf8'.

Any ideas on identifying where the issues occur?

Thanks

Mark
Equifax Limited is registered in England with Registered No. 2425920. Registered Office: Capital House, 25 Chapel Street, London NW1 5DS. Equifax Limited is authorised and regulated by the Financial Conduct Authority.
Equifax Touchstone Limited is registered in Scotland with Registered No. SC113401. Registered Office: Exchange Tower,19 Canning Street, Edinburgh, EH3 8EH.
Equifax Commercial Services Limited is registered in the Republic of Ireland with Registered No. 215393. Registered Office: IDA Business & Technology Park, Rosslare Road, Drinagh, Wexford.

This message contains information from Equifax which may be confidential and privileged. If you are not an intended recipient, please refrain from any disclosure, copying, distribution or use of this information and note that such actions are prohibited. If you have received this transmission in error, please notify by e-mail [hidden email]<[hidden email]>.
_______________________________________________
riak-users mailing list
[hidden email]
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com


_______________________________________________
riak-users mailing list
[hidden email]
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com


_______________________________________________
riak-users mailing list
[hidden email]
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com