Sunday, February 28, 2021
  • Setup menu at Appearance » Menus and assign menu to Top Bar Navigation
Advertisement
  • AI Development
    • Artificial Intelligence
    • Machine Learning
    • Neural Networks
    • Learn to Code
  • Data
    • Blockchain
    • Big Data
    • Data Science
  • IT Security
    • Internet Privacy
    • Internet Security
  • Marketing
    • Digital Marketing
    • Marketing Technology
  • Technology Companies
  • Crypto News
No Result
View All Result
NikolaNews
  • AI Development
    • Artificial Intelligence
    • Machine Learning
    • Neural Networks
    • Learn to Code
  • Data
    • Blockchain
    • Big Data
    • Data Science
  • IT Security
    • Internet Privacy
    • Internet Security
  • Marketing
    • Digital Marketing
    • Marketing Technology
  • Technology Companies
  • Crypto News
No Result
View All Result
NikolaNews
No Result
View All Result
Home Machine Learning

KaoKore: New Facial Dataset from Japanese Scrolls for ML

March 3, 2020
in Machine Learning
KaoKore: New Facial Dataset from Japanese Scrolls for ML
587
SHARES
3.3k
VIEWS
Share on FacebookShare on Twitter

Clash of Clans wasn’t a video game but rather a way of life in 10th century Japan. And of course the locals did not scroll through content options on their smartphones as we do now, rather they read actual scrolls. Japanese Emakimono (絵巻物) illustrated handscrolls and Ehon (絵本) picture books were popular storytelling media during the arts-and-culture focused Heian period. Scrolling through the text and images brings dynamic characters and vivid scenes to life in a calligraphy-captioned experience that is as close to cinematic as the tech of the time enabled.

With declining numbers of art historians who can understand traditional Japanese scrolls, preserving the media and messages is a challenge. Working on the premise that facial expressions offer especially rich information not only about the scroll’s content but also about how these artworks were created, a team of researchers from the ROIS-DS Center for Open Data in the Humanities (CODH), University of Cambridge, Google Brain and MILA has introduced a dataset of faces extracted from such pre-modern Japanese artwork.

You might also like

Machine Learning May Reduce Mental Health Misdiagnosis

AI & ML Are Not Same. Here's Why – Analytics India Magazine

Is Wattpad and its machine learning tool the future of TV? — Quartz

The KaoKore dataset includes 5552 RGB image files drawn from the 2018 Collection of Facial Expressions dataset of cropped face images from Japanese artworks. For use in supervised learning scenarios two sets of labels have been applied to the faces: male and female for gender, and social status classes noble, warrior, incarnation, and commoner.

image.png

The researchers have ensured the KaoKore dataset will work under different machine learning setups. They standardized image size and aspect ratio to 256 x 256 pixels. The images are formatted like those in ImageNet, enabling KaoKore to serve as an alternative dataset under existing unsupervised learning setups.

image.png
image.png

The researchers applied various generative models to KaoKore with results suggesting the dataset’s suitability for creative tasks. The SOTA GAN model Style GAN for example generated characters that aptly reflected the class variety in the dataset. Leveraging neural painting models meanwhile can create painting sequences from a single KaoKore image to offer insights on artistic technique and style by illustrating painting steps.

Understanding an Emakimono handscroll also requires reading the cursive texts that tell the stories. These are presented in the kuzushijiwriting style that was used in Japan from the 8th through 19th centuries. Today however, only trained experts can read them, so the researchers used machine learning to automatically recognize and transcribe kuzushiji into modern Japanese characters.

image.png
image.png

Early work bridging machine learning and Japanese kanji characters drew on the digitalization of some 300,000 old Japanese books the National Institute of Japanese Literature (NIJL) and other institutes began in 2014. Bounding boxes were created for each character during the transcribing process for some of the books. The CODH researchers who curated the dataset suggested creating a separate dataset for bounding boxes could help machine learning techniques push automated transcription performance.

In 2018, CODH and researchers from the Royal Grammar School, National Institute of Japanese Literature, MILA, and Google Brain created the Kuzushiji-MNIST, Kuzushiji-49, and Kuzushiji-Kanji datasets. In 2019, almost the same group of CODH and MILA researchers proposed KuroNet, a new end-to-end model for kuzushiji recognition.

Machine learning tailored datasets and techniques can be expected to broaden research into and preservation of the pre-modern scrolls that are a huge part of Japanese art history.

The paper KaoKore: A Pre-Modern Japanese Art Facial Expression Dataset is on arXiv. The KaoKore and Kuzushiji-MNIST datasets are available on GitHub.


Journalist: Fangyu Cai | Editor: Michael Sarazen

Like this:

Like Loading…

Credit: Google News

Previous Post

Unsupervised Programming Language Models?! - Becoming Human: Artificial Intelligence Magazine

Next Post

Coronavirus Could Be Better Than Black Friday For These 4 Stocks

Related Posts

New AI Machine Learning Reduces Mental Health Misdiagnosis
Machine Learning

Machine Learning May Reduce Mental Health Misdiagnosis

February 28, 2021
AI & ML Are Not Same. Here's Why – Analytics India Magazine
Machine Learning

AI & ML Are Not Same. Here's Why – Analytics India Magazine

February 27, 2021
Is Wattpad and its machine learning tool the future of TV? — Quartz
Machine Learning

Is Wattpad and its machine learning tool the future of TV? — Quartz

February 27, 2021
New AI Machine Learning Reduces Mental Health Misdiagnosis
Machine Learning

New AI Machine Learning Reduces Mental Health Misdiagnosis

February 27, 2021
MindMed Closes Acquisition of HealthMode, a Leading Machine Learning Digital Medicine Company
Machine Learning

MindMed Closes Acquisition of HealthMode, a Leading Machine Learning Digital Medicine Company

February 27, 2021
Next Post
Coronavirus Could Be Better Than Black Friday For These 4 Stocks

Coronavirus Could Be Better Than Black Friday For These 4 Stocks

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Recommended

Plasticity in Deep Learning: Dynamic Adaptations for AI Self-Driving Cars

Plasticity in Deep Learning: Dynamic Adaptations for AI Self-Driving Cars

January 6, 2019
Microsoft, Google Use Artificial Intelligence to Fight Hackers

Microsoft, Google Use Artificial Intelligence to Fight Hackers

January 6, 2019

Categories

  • Artificial Intelligence
  • Big Data
  • Blockchain
  • Crypto News
  • Data Science
  • Digital Marketing
  • Internet Privacy
  • Internet Security
  • Learn to Code
  • Machine Learning
  • Marketing Technology
  • Neural Networks
  • Technology Companies

Don't miss it

Cybercrime groups are selling their hacking skills. Some countries are buying
Internet Security

Cybercrime groups are selling their hacking skills. Some countries are buying

February 28, 2021
New AI Machine Learning Reduces Mental Health Misdiagnosis
Machine Learning

Machine Learning May Reduce Mental Health Misdiagnosis

February 28, 2021
Why would you ever trust Amazon’s Alexa after this?
Internet Security

Why would you ever trust Amazon’s Alexa after this?

February 28, 2021
AI & ML Are Not Same. Here's Why – Analytics India Magazine
Machine Learning

AI & ML Are Not Same. Here's Why – Analytics India Magazine

February 27, 2021
Microsoft: We’ve open-sourced this tool we used to hunt for code by SolarWinds hackers
Internet Security

Microsoft: We’ve open-sourced this tool we used to hunt for code by SolarWinds hackers

February 27, 2021
Is Wattpad and its machine learning tool the future of TV? — Quartz
Machine Learning

Is Wattpad and its machine learning tool the future of TV? — Quartz

February 27, 2021
NikolaNews

NikolaNews.com is an online News Portal which aims to share news about blockchain, AI, Big Data, and Data Privacy and more!

What’s New Here?

  • Cybercrime groups are selling their hacking skills. Some countries are buying February 28, 2021
  • Machine Learning May Reduce Mental Health Misdiagnosis February 28, 2021
  • Why would you ever trust Amazon’s Alexa after this? February 28, 2021
  • AI & ML Are Not Same. Here's Why – Analytics India Magazine February 27, 2021

Subscribe to get more!

© 2019 NikolaNews.com - Global Tech Updates

No Result
View All Result
  • AI Development
    • Artificial Intelligence
    • Machine Learning
    • Neural Networks
    • Learn to Code
  • Data
    • Blockchain
    • Big Data
    • Data Science
  • IT Security
    • Internet Privacy
    • Internet Security
  • Marketing
    • Digital Marketing
    • Marketing Technology
  • Technology Companies
  • Crypto News

© 2019 NikolaNews.com - Global Tech Updates