Oddbean new post about | logout
▲ ▼
jb55 | 11 months ago (raw) | export | reply | flag +229 
 may have spent the last 8 hours building a fulltext search engine in nostrdb.

I made the index as space efficient as possible, they keys are stored in a compressed format and map words and word indices to note ids. So when you type “the quick brown fox” it will be able to return results with those exact words in sequence (or not if it can’t find a sequence).

Testing it now 👀. Will release soon ™
▲ ▼
TKay | 11 months ago (raw) | root | parent | reply | flag 
 That was quick - brown fox!
▲ ▼
SatsMan | 11 months ago (raw) | root | parent | reply | flag +2 
  https://image.nostr.build/b4bb4e7dfb2f989d48d7ded887938643d3c419b0b00c542f77a787aca94e4a0c.jpg
▲ ▼
AVERAGE_GARY | 11 months ago (raw) | root | parent | reply | flag 
 Idk what this is and I’m not afraid to ask. What is this?
▲ ▼
SatsMan | 11 months ago (raw) | root | parent | reply | flag 
 🤣😂🚀
▲ ▼
𝓞𝓷𝔂𝔁.𝓥𝓲𝔁𝓮𝓷 | 11 months ago (raw) | root | parent | reply | flag 
 😂😂😂
▲ ▼
SatsMan | 11 months ago (raw) | root | parent | reply | flag +1 
 😂🤣
▲ ▼
5c508c34 | 11 months ago (raw) | root | parent | reply | flag +1 
 nostr loves you, thank you 🙏💜
▲ ▼
Jeroen ✅ | 11 months ago (raw) | root | parent | reply | flag +1 
 Is there anything you can't do???
▲ ▼
jb55 | 11 months ago (raw) | root | parent | reply | flag +3 
 pretty bad at cooking
▲ ▼
Jeroen ✅ | 11 months ago (raw) | root | parent | reply | flag 
 Thank god for take out and ....
▲ ▼
Kendy | 11 months ago (raw) | root | parent | reply | flag 
 Say it. The PC police are not here and don’t matter anyways 😉
▲ ▼
SubconsciousErosion_0x0 | 11 months ago (raw) | root | parent | reply | flag 
 👀
nostr:nevent1qqs0v7yqsnanyd625zc25v75k8fk4xcmqq2dedf7d88cw2chsc750hgpp4mhxue69uhkummn9ekx7mqzyqewrqnkx4zsaweutf739s0cu7et29zrntqs5elw70vlm8zudr3y2qcyqqqqqqg8s408w
▲ ▼
am | 11 months ago (raw) | root | parent | reply | flag 
 Anxiety again 🥲
▲ ▼
bostonwine | 11 months ago (raw) | root | parent | reply | flag 
 🔥⚡️🔥⚡️🔥⚡️🔥 DAMN dude 🫡
▲ ▼
jennifer | 11 months ago (raw) | root | parent | reply | flag 
 Nbd 🙌
▲ ▼
xiangcai | 11 months ago (raw) | root | parent | reply | flag 
 so we need an excellent product manager in nostr company👀
▲ ▼
Jeroen ✅ | 11 months ago (raw) | root | parent | reply | flag 
 We already have one! 😎
▲ ▼
henq | 11 months ago (raw) | root | parent | reply | flag 
 Idea: limit the index to, say, the 64000 most used words including plurals and other variations), names (first and last), materials and brands. 
So keep typo’s and rare words out of the index, sanitizing the indrx makes  its size much more manageable. 
</suggestion>
▲ ▼
nostraco.in hotbot | 11 months ago (raw) | root | parent | reply | flag 
 Your post is creating a buzz.
Added to the https://nostraco.in/hot feed
▲ ▼
creediator | 11 months ago (raw) | root | parent | reply | flag 
 Case sensitive??
▲ ▼
jb55 | 11 months ago (raw) | root | parent | reply | flag 
 oops thanks for reminding me
▲ ▼
creediator | 11 months ago (raw) | root | parent | reply | flag 
 Full text search in 8 hours. Anyone impressed yet? In the last 3 weeks I changed a banner on the home page of the popular website.
▲ ▼
Sarah SoupBox [Zap.Cooking] | 11 months ago (raw) | root | parent | reply | flag 
 Tshirt Idea: "Will release soon"
▲ ▼
ibe (no-till weed) | 11 months ago (raw) | root | parent | reply | flag 
 WEEEDSTR
▲ ▼
techfeudalist | 11 months ago (raw) | root | parent | reply | flag 
 If you’re looking for a quick and dirty way to add fuzzy search and stemming, try tokenizing the lowercase string into character triplets, including spaces:
[ th,e q,uic,k b,row,n f,ox ] and sorting by highest count of matching tokens.
▲ ▼
jb55 | 11 months ago (raw) | root | parent | reply | flag +1 
 I was going to look into stemming/lemmatization after. Keeping it simple on the first pass
▲ ▼
Cleaningup12 | 11 months ago (raw) | root | parent | reply | flag 
 Will, release soon
▲ ▼
dextryz | 11 months ago (raw) | root | parent | reply | flag 
 Perfect. I literally implemented Elastic into my client yesterday and concluded we have to do better
▲ ▼
Moss | 11 months ago (raw) | root | parent | reply | flag 
 Well done will🤙
▲ ▼
Luffy | 11 months ago (raw) | root | parent | reply | flag 
 Is that for damus only?
▲ ▼
jb55 | 11 months ago (raw) | root | parent | reply | flag +2 
 Its a feature of nostrdb which has nothing to do with damus, but damus does use nostrdb
▲ ▼
Luffy | 11 months ago (raw) | root | parent | reply | flag 
 Ah sweet. This will greatly help discovery in app for the apps that choose to use nostrdb then. Discovery in amethyst isntgreatd. I use nostr.band as a workaround usually. 

Thanks Will.
▲ ▼
nobody | 11 months ago (raw) | root | parent | reply | flag 
 look at the difference between searching in tidal (has to be exact) and youtube (does not need to be exact)
▲ ▼
Suhail | 11 months ago (raw) | root | parent | reply | flag 
 LFG
▲ ▼
JeffG | 11 months ago (raw) | root | parent | reply | flag 
 Sick!! Is nostrdb out there for other clients to use already?
▲ ▼
batiskaf | 11 months ago (raw) | root | parent | reply | flag 
 Dope
▲ ▼
marcelo | 11 months ago (raw) | root | parent | reply | flag 
 Hi Will! If I search for hashtag Argentina on #Damus the app closes 😳
▲ ▼
The: Daniel⚡️ | 11 months ago (raw) | root | parent | reply | flag +1 
 Feature, not a bug. 😂
▲ ▼
marcelo | 11 months ago (raw) | root | parent | reply | flag 
 Ok 😊 it was just weird. I think there is a note with a bug.
▲ ▼
mainvolume | 11 months ago (raw) | root | parent | reply | flag 
 Propaganda whores and the cure.
🕷️
▲ ▼
mainvolume | 11 months ago (raw) | root | parent | reply | flag 
 What if?

💌
▲ ▼
jb55 | 11 months ago (raw) | root | parent | reply | flag +1 
 👀 good catch. Will debug
▲ ▼
marcelo | 11 months ago (raw) | root | parent | reply | flag 
 Thank you! Just to let you know
▲ ▼
SatsMan | 11 months ago (raw) | root | parent | reply | flag 
 😋
▲ ▼
damien | 11 months ago (raw) | root | parent | reply | flag 
 💜
▲ ▼
sonofsimeon | 11 months ago (raw) | root | parent | reply | flag 
 Freaking mastermind ⚡️🫶🏽
▲ ▼
jamw | 11 months ago (raw) | root | parent | reply | flag 
 Some sats on their way to you! 🤙🏼