How do you troubleshoot searches with excessive truncation?How do you troubleshoot searches with excessive truncation?If the search times out or takes a long time to complete, one possible issue may be: Excessive use of Wildcard truncation
Example of excessive truncation:
- Truncation, wildcard truncation in particular, is expensive, search-wise. Basically if you are in 5 databases and you have 100 terms using wildcard truncation, the system has to search for 10 term variations X 100 terms X 5 databases. That is a LOT of processing work.
- If you have plurals and British/American terms turned on--many terms can have wildcard truncation removed
- Look at the truncated terms and see if using [*3] or $4 makes more sense or just add the term variation(s) to the search
This was one set of a fairly long search that contained a lot of truncation
pd(<20181101) AND ti,ab(mouse OR mice OR murine OR gerbil* OR rabbit* OR rat* OR rodent* OR hamster* OR pig* OR swine OR porcine OR hog* OR sheep* OR monkey* OR chimp* OR dog* OR canine OR horse* OR equine OR cow* OR cattle OR bovine OR cynomolgus OR owl* OR avian OR bird* OR chick* OR frog* OR toad* OR amphibian* OR cats OR feline* OR chinchilla* OR macaque* OR lamb* OR gerbil* OR ferret* OR goat*)
NOTE: There are 26 wildcard truncated terms in this set, running in 3 databases, searched in 2 fields (tio, ab). This means 10 X 26 X 2 X 3--just for this set.
Here's my edited version of this set: Note-I removed the date limiter which was on EACH set. When a search has issues, limiters are best moved to the end.
ti,ab(mouse OR mice OR murine OR gerbil OR rabbit OR rat OR rodent or rodentia OR hamster OR pig or piglet OR swine OR porcine OR hog OR sheep OR monkey OR chimp or chimpanzee OR dog OR canine OR horse OR equine OR cow OR cattle OR bovine OR cynomolgus OR owl or owlet OR avian OR bird OR chick or chicken OR frog OR toad OR amphibian OR cat OR feline OR chinchilla OR macaque OR lamb OR ferret OR goat)
Many terms had wildcard truncation where there wasn't a plural-such as sheep. Other terms would be captured by our normal plural process, such as dogs, pigs or cats. I added owlet, piglet, and rodentia to ensure full coverage.