𝔊𝔴𝔢𝔯𝔫@gwernJan 22(I *believe* I did provide the hash precommitment on /r/dnm or somewhere, maybe the Sheep writeup, but just in case I didn't, to be clear:
`$ echo 'Sheep Marketplace was founded and run by Tomáš Jiřikovský (random nonce: 19093)' | sha512sum`)
1,968
29
1.5%
View post activity
𝔊𝔴𝔢𝔯𝔫@gwernJan 21Unnoticed by all, perhaps even themselves, somewhere between 2010 & 2030, 'eDNA' researchers disproved the existence of Bigfoot & the Yeti.
(This followed up 23andMe's disproof of alien-human hybrid changelings or Caucasians being aliens from outer space.)
𝔊𝔴𝔢𝔯𝔫@gwernJan 18Playing around some more with MJv6 and much more minimalist prompts: I still don't have an intuition `--weird` and it seems like it cancels out `--chaos` to a considerable extent, but `--tile --chaos 20` seems very nice for dropcap variety+quality.
𝔊𝔴𝔢𝔯𝔫@gwernJan 17(What would my 'Hamming question' be? Maybe: "what are you working on, and why isn't it AGI or better left to an AGI?"
Might be amusing to try to summarize everyone like that... 'ROBIN HANSON: what is X that you work on, and why is X actually about Y?')
𝔊𝔴𝔢𝔯𝔫@gwernJan 12We've updated popups for the new HTML Arxiv, but it's still too buggy to rely on...
Today I filed a bug report about most of a paper being missing; then I filed a bug report about the report-bug tool not working at all; then I filed a bug report about it not working in Chromium!
3,605
31
0.9%
View post activity
𝔊𝔴𝔢𝔯𝔫@gwernJan 10(It's kind of impressive. I've been testing out & reporting poems since July 2020, so there must be several hundred reported failure examples from me alone, and yet, here we are in 2024 and it's blandly writing A/B/A/B and insisting that it's doing eg Browning's blank verse.)
2,107
29
1.4%
View post activity
𝔊𝔴𝔢𝔯𝔫@gwernJan 10Incidentally, 20 failed (and reported) poems later, I can report that neither ChatGPT-3/4 can do non-rhyming poems yet. They also just confabulate rhymes if you ask for blank verse and confabulate that it is blank. You can still few-shot them... except they'll rhyme at the end 😩
𝔊𝔴𝔢𝔯𝔫@gwernJan 10Reviewing my ChatGPT conversations for failed image gens and checking some of the coding ones, interesting to see ChatGPT-4 now getting right things it confabulated about back in Oct-Dec 2023.
𝔊𝔴𝔢𝔯𝔫@gwernJan 9The relationship of genes & epigenetic markers continues to befuddle people and we don't have a good quip or metaphor to explain that epigenetics mostly mediates/is a mechanism. How's this:
"Epigenetics cause a trait the way bank account deposits/withdrawals cause your wealth."
6,466
338
5.2%
View post activity
𝔊𝔴𝔢𝔯𝔫@gwernJan 9(Don't you love that exploding-sun T or that rubricated-blood V? You can get so many good ones when you spend some time generating in bulk & screening. People really ought to be more selective when doing AI art: quality matters so much more than quantity at this point.)
4,453
46
1.0%
View post activity
𝔊𝔴𝔢𝔯𝔫@gwernJan 9After a bunch of experimenting, we've found Recraft's default is not good (and have told them), but now can generate SVGs which are only 10-100kb on the wire!
Demo of live SVG dropcaps MJv5->Recraft->SVG in a webpage (just missing automatic space adjustments): pic.twitter.com/FRbunnXW5i
𝔊𝔴𝔢𝔯𝔫@gwernJan 8A "gaff" is an embarrassing mistake or blunder, such as misspelling a common word.
4,356
27
0.6%
View post activity
𝔊𝔴𝔢𝔯𝔫@gwernJan 8I have noticed a concerning tendency in Western Christmas cuisine to replace the traditional English fruitcake with other breads, often more heavily sugared, but still call it 'fruitcake'. This is stollen valor.
3,637
33
0.9%
View post activity
𝔊𝔴𝔢𝔯𝔫@gwernJan 8(Amusingly, DALL-E 3 is *much* happier to generate cat feces than is Midjourneyv6.)
𝔊𝔴𝔢𝔯𝔫@gwernJan 8(People sometimes ask "where are our cathedrals?"
Right there—in Mann's Chinese Theater and the multiplexes. Staggeringly-complex projects consuming thousands of man-years by the most talented artisans dedicated to realizing a vision 𝘢𝘥 𝘮𝘢𝘪𝘰𝘳𝘦𝘮 𝘋𝘦𝘪 𝘨𝘭𝘰𝘳𝘪𝘢𝘮.)
3,057
123
4.0%
View post activity
𝔊𝔴𝔢𝔯𝔫@gwernJan 8"We need 50,000 tiny plastic skulls we can drop from a grate onto Aragorn." "Oh, phew, I was worried you'd ask for something hard - like building two identical versions of Bag End except everything is twice as big in the other." "Nah, we already have guys on that one. Deadlines."
5,366
77
1.4%
View post activity
𝔊𝔴𝔢𝔯𝔫@gwernJan 8... youtube.com/watch?v=057B94…
Or building multiple building-sized versions of cities for a few shots? youtube.com/watch?v=MM2WX5… Or forced-perspective shots where everything is on timed robotics like a table that pulls away in sync with the camera so Gandalf looks taller than Frodo?
1,379
155
11.2%
View post activity
𝔊𝔴𝔢𝔯𝔫@gwernJan 7The underlying models are presumably nevertheless far more general than their predecessors like DALL-E 2... but maybe not as much general as you'd think from the general quality increase, and it very hard to undo the RLHF/instruction-tuning specialization/braindamage.
1,107
21
1.9%
View post activity
𝔊𝔴𝔢𝔯𝔫@gwernJan 7DALL-E 3: after the 1st 5, I told it 'OK, now generate an image on the theme "in praise of shadows", but which is different from all the previous prompts.' or 'generate another, again different from all of them' for 26 samples.
Still deeply same-y: gwern.net/doc/ai/nn/tran…
1,334
55
4.1%
View post activity
𝔊𝔴𝔢𝔯𝔫@gwernJan 7Here are 16 Midjourneyv6 samples for 'in praise of shadows'; since there's no way to really generate diversity and just that resulted in similar outputs, I changed up the wording using punctuation, swapping order, etc. Nevertheless, uncanny similarity: gwern.net/doc/ai/nn/diff…
392
46
11.7%
View post activity
𝔊𝔴𝔢𝔯𝔫@gwernJan 7One downside of the better models is that they get a lot narrower in outputs, I think, even as they get a lot better quality-wise. For example, my prompt 'in praise of shadows'. DALL-E 2 feels a lot more diverse (however artifacted & low-res) than either DALL-E 3 or Midjourneyv6.
𝔊𝔴𝔢𝔯𝔫@gwernJan 6(That is, for a long time a pair of identical twins could fairly straightforwardly travel, AFAIK, on a single passport: travel one at a time, and mail it back. But if databases track whether you're 'in' or 'out' and all crossings are monitored, you can't go through twice.)
3,838
134
3.5%
View post activity
𝔊𝔴𝔢𝔯𝔫@gwernJan 6If two identical twins wanted to live as a single person (like _The Prestige_), they could still get away with it easily today in the US, couldn't they?
Only hard scenario I can think of is international travel: can't mail a passport back & forth now that databases track status.
10,801
389
3.6%
View post activity
𝔊𝔴𝔢𝔯𝔫@gwernJan 6“Here, Mr Rainsford, I hunt… the most dangerous game.”
“Surely you don’t mean—𝘮𝘢𝘯‽”
“Goodness, no. I hunt Big Foot, the Sasquatch, the—see, now you think I’m a lunatic and are already thinking up excuses to leave! What other game is so dangerous to hunt?”
4,045
28
0.7%
View post activity
𝔊𝔴𝔢𝔯𝔫@gwernJan 6Sometimes after a pass through /newest, particularly pg2+, I'll see 4 of my upvoted links hit the front page.
Even if that fails, upvotes help the 'second chance' pool where they will be resubmitted.
Crazy to think how many tens of millions of pageviews I must've caused by now.
4,274
97
2.3%
View post activity
𝔊𝔴𝔢𝔯𝔫@gwernJan 6Underrated way to use HN, especially as a high-karma user: voting on stuff on /newest , including looking up 'failed' links using hn.algolia to upvote.
Were you one of the (I'd estimate) >50,000 people today who read news.ycombinator.com/item?id=388860… (+906, 174 comments)?
You're welcome.
𝔊𝔴𝔢𝔯𝔫@gwernJan 1To all things there is a season; a season to be born and a season to die.
/r/MLscaling has been useful, I think, but I have begun to wonder if it's starting to outlive its usefulness in 2024: reddit.com/r/mlscaling/co… ?
2,724
233
8.6%
View post activity
𝔊𝔴𝔢𝔯𝔫@gwernJan 1Jan 2024: in the past year in the West, we've seen GPT-4/-V/Gemini, MJv6/DALL-E-3, GAN revival...
I continue to hear Chinese DL will overtake any day now.
What 3 Chinese AI results are as important (and aren't just, like Bytedance, based on massive copying of OA API outputs)?