UnicodeDecodeError: 'utf8' codec can't decode bytes in position 1618-1619: invalid data

[Siva.S@…]

How to Reproduce

While doing a GET operation on /search, Trac issued an internal error.

(please provide additional details here)

Request parameters:

{'noquickjump': u'1', 'q': u'AUDIT_STATUS', 'repo': u'on'}

User Agent was: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.5) Gecko/2008120122 Firefox/3.0.5

System Information

Trac	0.11
Python	2.5.2 (r252:60911, Feb 21 2008, 13:11:45) [MSC v.1310 32 bit (Intel)]
setuptools	0.6c9
SQLite	3.3.4
pysqlite	2.3.2
Genshi	0.5.1
mod_python	3.3.1
Subversion	1.5.1 (r32289)
jQuery:	1.2.3

Python Traceback

Traceback (most recent call last):
  File "C:\Program Files\VisualSVN Server\Trac\python\lib\site-packages\trac-0.11-py2.5.egg\trac\web\main.py", line 423, in _dispatch_request
    dispatcher.dispatch(req)
  File "C:\Program Files\VisualSVN Server\Trac\python\lib\site-packages\trac-0.11-py2.5.egg\trac\web\main.py", line 197, in dispatch
    resp = chosen_handler.process_request(req)
  File "C:\Program Files\VisualSVN Server\trac\python\lib\site-packages\trac-0.11-py2.5.egg\trac\search\web_ui.py", line 106, in process_request
    results += list(source.get_search_results(req, terms, filters))
  File "build\bdist.win32\egg\tracreposearch\search.py", line 79, in get_search_results
    self.indexer = Indexer(self.env)
  File "build\bdist.win32\egg\tracreposearch\indexer.py", line 134, in __init__
    self.reindex()
  File "build\bdist.win32\egg\tracreposearch\indexer.py", line 97, in wrap
    return f(*args, **kw)
  File "build\bdist.win32\egg\tracreposearch\indexer.py", line 247, in reindex
    self._invalidate_file(node.path)
  File "build\bdist.win32\egg\tracreposearch\indexer.py", line 229, in _invalidate_file
    word_files = self.words[word]
  File "build\bdist.win32\egg\tracreposearch\indexer.py", line 42, in __getitem__
    return self._cache.setdefault(key, set(self.dbm[key].decode('utf-8').split(pathsep)))
  File "C:\Program Files\VisualSVN Server\trac\python\lib\encodings\utf_8.py", line 16, in decode
    return codecs.utf_8_decode(input, errors, True)
UnicodeDecodeError: 'utf8' codec can't decode bytes in position 1618-1619: invalid data

[Christian Boos]

  File "build\bdist.win32\egg\tracreposearch\indexer.py", line 42, in __getitem__
    return self._cache.setdefault(key, set(self.dbm[key].decode('utf-8').split(pathsep)))

Well, that plugin (​TH:RepositorySearchPlugin) needs fixing… (hint: there's probably no systematic encoding to 'utf-8' done when storing values into that dbm dictionary).

Please report the error there.

[Christian Boos]

Sorry, correct link is ​TH:RepoSearchPlugin