Anime technology

Anime technologies
what kind of technologies do you apply to your animes Cred Forums

personally I use a rather simple sorting and renaming script to manage my collection, but my pride and joy is a Elo ranking system with over 10,000 images logged into the system. Using a combination of tournament style ladder matches, double blind random choices, and various other filters and controls and over 20,000 operations the Elos are currecntly 90% accurate in predicting the 'cuter' image despite the filters applied to selection. that is twice as accurate as international chess rankings.

Anyone else have anything like this?

Other urls found in this thread:

u.teknik.io/cr3n8.zip
github.com/sora-chan/bklg
alteredqualia.com/visualization/evolve/
youtube.com/watch?v=z23Gzp0RTOg
github.com/Oros42/BooruMirror
hydrusnetwork.github.io/hydrus/help/getting_started_subscriptions.html
flexget.com/Install
github.com/fake-name/DanbooruScraper
pastebin.com/GdsrV1h7
github.com/hydrusnetwork/hydrus/commits/master
pillow.readthedocs.io/en/3.3.x/installation.html
pastebin.com/YA99YWTS
pastebin.com/6ABGFXWy
github.com/haasn/hsbooru/blob/master/HsBooru.hs
pastebin.com/qBFhdvTH
lmgtfy.com/?q=mpdhanyuu
pastebin.com/n6UunMqZ
pastebin.com/wxqESNgT
twitter.com/NSFWRedditVideo

...

That's really impressive. The best i have is a simple script to count the files in each of my cute anime pic subfolders, and return the value. And one to open a random pic of maki. Looking forward to hearing about anime related technology and programming—so have a bump on me

which k-on does it say is the cutest

>not training a neural net with that data to predict the cuteness of new images without needing to specify it yourself

beep boop calculating calculating
the result is: Akiyama Mio and in last place Mugi

mooo

haha ritsu owned

that's the next step
I wish the images had tags because then i wo-
actually i can get tags on the images so im going to use the scrores to make a booru searcher that finds the best image based on tags
neural network sounds hard

Mugi is NOT the least cutest

sorry its science

that's completely useless unless they make a "good_art" tag because a ton of stuff on the booru is garbo even if the tags are good

what if it finds some hidden artist in the ghost in the tags or something like that
its already a pain to search boorus so it would just help think of ideas for searches

Can you post the source code?

is this the new anime thread

no its really embarrassingly bad

Khorosho

It can't be that bad. Please?

you need to run it from vim or change the part that recoses the window
you need to remove the first empty line from the table generated from table generator
you need to change all the directories to yours

u.teknik.io/cr3n8.zip

changing the 'league' string to different folder names (only the parts before the first space lol) will restirct it to only those images
other options are 'random' 'new' 'cuttest' 'high' 'low' and I think that's all of them

goodluck getting it working

pls give nichijou images

i am working on getting caffe to work for my own programs so taht i can make it auto-tag my wallpapers

I am probably gonna hook it to some *bouro or somethign to get lots of pre-done sources to train on

Unfortunantly i dont relly get how caffe is put together. It seems to require putting all inputs and outputs into lmd databases and then uses that.

post the cutest image already faggot

she already did it's on top of the op image

>you need to run it from vim
dropped

here

i said it was terrible
you can change that to whatever title or id you give your terminal running it

hanging breasts are the best

your algorithm has good taste

pls don't be gross

you live an empty meaningless existence weeb

What kind of technology do we need to make anime real?

Bump

this is some incredibly autistic shit, OP

but it's awesome. You're the pioneer of weeb software, creating new opportunities for scientists to achieve perfection in cute anime girls. We need people like this to move mankind towards the future where catgirls will finally become reality

...

I made a tool to keep track of my anime.
github.com/sora-chan/bklg
The code is old and shit though.

Weirdos

Pretty good.

the best technology for us anime fans is a helium tank for suicide! As an anime fan i really recommend suicide to all people who like anime, just like me! Suicide is the fastest way to meet your wi-fu. My wai-fu is Sakura from Naruto, shes really kawayy hahahha lets commit suicide all toghether my fellow anime lovers

Only tech I apply to my animu is an old usb-2 dock station in which I plug various sata drives from time to time to archive stuff.
I stopped bothering to save and catalog anime images many years ago. It's life consuming. I even had an anime galleries website with ~50k monthly pageviews back in the early 2000s.

If you give me the dataset I can make a neural network to generalize on your concept of cute and post it on github for your own use...

i wrote a python script that does it's best to reproduce a cute anime pic using only circles of various colours and sizes
here's the one it's working on now, it's about half way done can you tell who it is???

kindof interesting. Please tell me that it is higher res than that

Ram

why are the circles moving?

it can scale up the circles arbitrarily
while it's running it uses a low resolution because comparing the difference between two images of high resolution takes a MASSIVE amount of time

what?

how does it determine what size circles to use?
does it like check the area around one point to see if the colors near it are similar enough to keep using it?

Ram?

the circles are moving

how long until I can put some helmet on my head that will measure how cute I perceive an anime image while building a profile of my preferences then feeding me the cutest images from the internet, producing a feedback loop that will bring me to the cuteness fixed point in a minimal amount of time

it starts with random size and position, then changes it slightly, if the new position/radius/color results in an image closer to the original it keeps that change and starts over
you're right congratulations u win the original pic
i don't think they are

I wrote a script that used RSS feeds to download torrents off of nyaa and add them to transmission. But then I discovered flexget.

If you ever get that finished and working, could you please post it?

>randomly choosing
i would have thought that you would do edge detection, pick two random points on 2 lines of the same blob and use that as your circle

i am a ways off right now, but yes
i have their example code compiling on my system using my own build system
i dont quite get how they have things meshing
it seems to require a database to read from which will be terrible for processing MASSIVE amounts of images i think as it probably tries to load the whole thing into memory at once.

your algorithm is garbage

i tried something similar while ago but i wasn't getting very far with it and dropped the idea

i also thought about using edge detection to compare the images, it might result in nicer lines

His algorithm is a sorting algorithm in O(Nlog(N)). It's fairly effective since he seemed to divided them according to cuteness.

No I meant it's garbage because it put Mio in first place.

yui is objectively the cutest keion

then redo the algorithm and see if you can get a better result with the same efficiency.

I've been working on testing waifu2x on 1080p bluray video by dumping the video to individual frames, upscaling them individually, and reencoding. Trying to get good quality anime-specific 4k upscaling...

it's too bad the algorithm can't take personality into account
yet

precomputation:
1: ritsu
2: azusa
3: mio
4: mugi
5: yui

OWNED

I tried that on something before too. Ran for a very long time. Anyways, i gave up when i couldn't get the audio back in sync. Looked alright though.

friend, i think you meant to type
1) yui
2) azusa
3) ritsu
4) mio
5) mugi
glad i could help correct your typo (V●ᴥ●V)

I'm running it on a university computer cluster, so 20min of footage only takes a few hours to run it on all frames

ffmpeg has weird options for framerate, i suspect i'll end up running into the same issues...

>it starts with random size and position, then changes it slightly, if the new position/radius/color results in an image closer to the original it keeps that change and starts over
that is an genetic algorithm, much like this one: alteredqualia.com/visualization/evolve/

I once wrote a version of this that ran on OpenGL

triangles are much faster to render than circles

ui pls go

Mugi has bigger tits than Mio, plus she's plumper and has a better ass.
>Not wanting to have Mugi as your sugar mama

true but i need them to be circles for reasons

If you'd label your charts then maybe I would understand what you want to show me.

>only caring about her body
shallow, pathetic, and despicable

:)

Moeblobs don't have a personality

also rendering takes almost no time at all, it's comparing the image that kills it

test

That's the thing, my implementation did everything on the GPU.

It first renders the image in a texture.
Then runs a shader that computes the per-pixel differences between the new render and the best candidate using a customizable function resulting in a floating point texture.
Now I just need to apply a reduce algorithm in order to average all the differences to get a fitness measure.
Fortunately glGenerateMipmap already does this and is implemented in hardware so I call it and read the smallest mipmap level wich is just one pixel (one floating point number).

Also I did some extra stuff to accelerate the generation.
For example based on the best candidate it generates N mutations and render each one following the steps above but intercalated. This takes advantage of queueing behavior of the GPU drivers.
Mutations that produce a worse result are straight out discarded while the top mutations of one generation are mixed if they are compatible (if they don't overwrite their changes) and retested before moving on to the next generation.

>tfw no gpu

youtube.com/watch?v=z23Gzp0RTOg
Now get your dakimakura.

>Mugi has bigger tits than Mio
bullshit

Any tips on writing a script to download a selected manga from madokami?

Literally generating moeblobs, nice.

Does anybody here scrape the *boorus? I've been thinking about making my own local copy of gelbooru because the website seems to be getting shittier and shittier

I found github.com/Oros42/BooruMirror but it's some PHP garbage. I wonder if there's some cleaner solution out there. I also want to be running this as a cron job so it should be easily resumsable and continue scraping where it left off.

share script? I wanna try it with some of my pics

tfw too dumb to use flexget. I've been using rss for deluge for far too long and I have to manually put in both the subscription and the torrent itself. flexget seems too complex for me. wanna dumb it on step by step for me senpai?

Have you tried Hydrus? I've only used it lightly, but it's designed for boorus/imageboards and has autistic level tagging abilities.

wrong
wrong
wrong
yuiazu best pairing

...

1. Mitsu (Mio and Ritsu)
2. Mio
3. Mugi & Yui & Ritsu & Ui
4. Jun and sawako and azusa

tfw no ui imouto

beep beep
best slice of life show coming through

2 bay usb3 dock, shared through windows to my network so i can watch my shit on my tv or my laptop.

>liking k-on this much

it's literally mankind's greatest achievement

this desu all other anime is shallow and worthless

It doesn't seem like hydrus can scrape sites like gelbooru at all?

Also, I got the BooruMirror thing to “work” but it's sort of weird. Basically it just scrapes “new” posts via the RSS, and only when people actually perform requests.

I could set up a cron job to do the update automatically, but I sort of want to get an existing archive of all images on gelbooru as well (which the RSS feed does not include)

how about no

This. Only a retarded straightshit would hate k-on

how about gtfo out of my thread idiot

BEEP BEEP
BEST SLICE OF LIFE SHOW COMING THROUGH

...

What? It's specifically for that.
Here: hydrusnetwork.github.io/hydrus/help/getting_started_subscriptions.html
I even see gelbooru in the screenshot.

Reminder Mugi got BLACKED

No, she's a lesbian.

mugi is boring

not as boring as your dumb posts nerd but i saved that pic

your boring idiot

:)
no u

Flexget has really good guides and documentation on how to use it. You can find the install guide here: flexget.com/Install

It goes step by step, all you have to do is follow along.

BEEP BEEP
ACTUAL BEST SOL COMING THROUGH

You should get banned for posting anime anywhere but Cred Forums just like /mlp/

Oh, I see. From the home page it just looked like a “make your own gelbooru”-type of thing, without any reference to the ability to scrape other sites.

Incidentally, I also found github.com/fake-name/DanbooruScraper which seems to be at least a step up from the php garbage

Anime Website

Doesn't apply now that Hiroshima is in charge.

anime website

anime website

You mean the jap dude who founded 2ch? If anything, that reaffirms the anime foundations of this site.

Okay, I managed to get danbooruscraper to run but it doesn't work at all, seems to be bitrotten; assertion failures, stalls, and the code is also a piece of shit. Finally, it seems to be geared around the assumption that I will only want a dump of the site as it is now and never again (it has no way to re-run or update, and the maximum ID is hard-coded)

tl;dr piece of shit. I'll try hydrus now, but it also seems to be broken to the core... fucking “script”langs man

Virtual reality?

Hydrus is still in active development. I do remember having to screw around with libraries and jazz to get it working, but after that it was great.

Yeah, getting hydrus running seems to be a royal pain. The entire thing is built like shit from head to toe as far as I can tell

It doesn't even print error messages to stderr, it prints them to crash.log in your db dir - which is fantastic if it fails before it even manages to find the db dir (e.g. because of an import failure)

the code is also unreadable because it has fucking whitespace for blank linse as well, which my editor marks as an error (as it rightfully should)...

it's a bit embarassing but ok, i'm not sure how much explaining it needs so i tried to make it just werk
i put some default values in so if you just save something named 'src.jpg' in the same dir as the script and run it then it should work
keep in mind it's really slow especially if you use a large source image, and larger numbers = more accurate end pic but more time to get there
pastebin.com/GdsrV1h7

also, the ram pic finished and this was the result
for some reason it never painted her shoulders

holy shit, and when I thought this piece of shit couldn't get any worse

>the git commits
>the fucking git commits
github.com/hydrusnetwork/hydrus/commits/master

just end me now. Nobody can seriously be THIS bad at programming. I think it's time to make my own. Fuck's sake

oh i for got it also requires pillow
pillow.readthedocs.io/en/3.3.x/installation.html

and again, wait, i just saw an error
fixed
pastebin.com/YA99YWTS

pastebin.com/6ABGFXWy
ok there, i actually tested it this time

YOU don't have a personality

>I think it's time to make my own.
More choices is always better. It's worked okay for what I've done with it, but I think the python gui gets bogged down a bit.

I'm in the process of writing my own ATM, in case you want to contribute. (I'm writing it in Haskell, and using Xapian as the tagging database + scalpel as the scraping backend)

I've not touched Haskell, but I'd be interested to look at it anyway.

Try killing yourself. That way you will never have to see those evil animes again.

Well, I gave it a start: github.com/haasn/hsbooru/blob/master/HsBooru.hs

Currently only the gelbooru scraper is implemented, and it doesn't download the actual files or store the tags yet.

Spent most of my time trying to find a good solution for the tag database but I settled on xapian which seems like a perfect fit. I will be integrating that next.

dude, i love it
i am in a graphics class now and would like to see your code

Mio is best!

Hey dude, nice try but you were getting bit by some small things that are not apparent in python
pastebin.com/qBFhdvTH

I modified the Painting class to us image.load() instead of the SLOW image.getpixel()

Also, more applicable to more programming in python and other things- making a list of errors and then adding them at the end is terrible as a lot of allocation can happen. Instead, if you are only going to add them at the end, just add each value as you go

Also - please comment your code
you will forget in 2 days what something is without them

i just had an idea after looking at this run
why not look at a rectangle the size of the circle for the comparison instead of the whole image?
then the number of comparisons is actually a lot smaller per pass, unless i am not really seeing all that is happening when i just look at it every now and then

bedtime bump

>it starts with random size and position, then changes it slightly, if the new position/radius/color results in an image closer to the original it keeps that change and starts over
That sounds incredibly inefficient.

I challenge you to find a more efficient way than a genetic algorithm.

Convolutional Neural Autoencoder

wow thanks that is so much faster
i tried this earlier, the problem is that the circles tended to all group together into places that were already similar to the source image. and in turn left big swathes of empty space

Well, we're up and running (basics only)

Still no real front-end though, so right now I'm hard-coding values and using queries straight from GHCi

Won't take much more work though

>github.com/sora-chan/bklg
Nice, did wrote something (even more shitty) like that but with anidb ed2k hash support.

Gonna give mpdhanyuu a try too, looks interesting.

And now we wait

at this rate it will only take me about half a year

>animes

Fuck off; are you american? The plural of anime isn't "animes" you dumb fucks.

I hope you're throttling. Place like that will ban your IP if you burn to much bandwidth and they have a competent admin.

My network bandwidth is shit, so I'm effectively already being throttled.

Also, I'm not really worried about IP bans. If they ban me, I'll try again with a different IP and a slower download rate.

i made the change this mornign to try a small search box around the last stroke instead of the whole image, and so far the results look good

this is roughly 250 strokes in

also i am noting that it doesn't like very detailed images

Not much I just changed all my folder icons to anime icons.

shouldn't the circles be smaller still?

How do you determine "cuteness"?

in my opinion, yeah it should be
but in the code the default max size circle is 60/650 * image width
i will change it when i get back to my computer and run another test

Using circles to define curvature, the rounder a object is the more cute it likely is. Other factors play in such as color, size, and position.

Damn, that's some computer vision shit. I could never get into that, must be really complex.

I had a shit grade when I tried to make a crude facial recognition prototype in college, lol.

I actually took a image processing class where we utilized opencv. My last project was kinda crude, but it was to show how a computer can detect shapes on some old drawings I did for /jp/.

yeah I used openCV as well, but I still can't get my head around all that shit. I never took any classes on it though. The most I do now is some simulation stuff with behaviour (rain, cells, movement, etc)

That's not cute. That's just lewd.

>Gonna give mpdhanyuu a try too, looks interesting.
Would appreciate any feedback and suggestions, it's my latest project.

Will do, it's gonna run almost 24/7.

anime website

>anime website
>90% is not about anime

Anime website.
Also, there's more interesting and cool stuff in this thread than there are in any other threads.
Makes you think, huh.

Who are you quoting?

you're mum

I am not mum.

>MAL
:^)

>I Want to Generate Moeblobs too but I'm Scared of the Command Line?!
What should our heroine do first?

>install gentoo

...

What is mpdhanyuu? Even google doesnt give me any results

...

Why the fuck are you archiving that much garbage?
You won't watch it ever again, it's useless...

Try harder at googling

lmgtfy.com/?q=mpdhanyuu

well this is one with 5000 circles
i think i have had my fun with this one

wrong idiot

so i discovered a pretty big bug in the moeblob script here's the fix
now it keeps randomizing the circle until it finds a good spot to start and then it starts mutating it
also uses floating point for the comparison so it doesn't get stuck once changes start becoming small
pastebin.com/n6UunMqZ

ugh wrong one
pastebin.com/wxqESNgT

i merge the change in with my version, and it seems to help some

currently i am thinking that i might change the mutation method

- have it check each direction for error
- have it check both larger & smaller radius
- pick the smallest error of all 7 (not changing included)

bump

you'll need all 10,000 images too right
internet is spotty right now, can you email me or something and ill get back to you
it's atleast 5 gigabytes

[email protected]

what if you started with a very downsized version of the image for comparisons to make processing faster and then slowly stepped it up to the full resolution over time