<?xml version="1.0" encoding="UTF-8"?>
<feed xmlns="http://www.w3.org/2005/Atom" xml:lang="en">
    <title>Aron Petau - google cloud</title>
    <link rel="self" type="application/atom+xml" href="https://aron.petau.net/tags/google-cloud/atom.xml"/>
    <link rel="alternate" type="text/html" href="https://aron.petau.net/"/>
    <generator uri="https://www.getzola.org/">Zola</generator>
    <updated>2022-04-01T00:00:00+00:00</updated>
    <id>https://aron.petau.net/tags/google-cloud/atom.xml</id>
    <entry xml:lang="en">
        <title>Ällei</title>
        <published>2022-04-01T00:00:00+00:00</published>
        <updated>2022-04-01T00:00:00+00:00</updated>
        
        <author>
          <name>
            Aron Petau
          </name>
        </author>
        
        <link rel="alternate" type="text/html" href="https://aron.petau.net/project/allei/"/>
        <id>https://aron.petau.net/project/allei/</id>
        
        <content type="html" xml:base="https://aron.petau.net/project/allei/">&lt;h2 id=&quot;Meet_Ällei_-_the_accessible_chatbot&quot;&gt;Meet Ällei - the accessible chatbot&lt;&#x2F;h2&gt;
&lt;h3 id=&quot;Sommerblut&quot;&gt;Sommerblut&lt;&#x2F;h3&gt;
&lt;p&gt;Natural Language Understanding fascinates me and recently I started collaborating with the team of the Sommerblut Festival in Cologne to deliver them a customized chatbot that will be able to communicate with everyone, respecting accessibility standards to include all people. It will be able to communicate in German Sign Language (DGS), as well as service blind people, and we aim to incorporate the simple language concept.&lt;&#x2F;p&gt;
&lt;p&gt;I find it to be an amazing challenge to start out with the requirement of really being inclusive. In ordinary social contexts, it is often not obvious, but when analyzing the specific needs a blind person has browsing the internet, it is drastically different from a person having impaired hearing. To hold the same conversation with both of them is proving quite a challenge. And this is just the first step down into a very deep field of digital inclusiveness. How can people with a speech impediment use our tool? How do we include people speaking German as a foreign language?&lt;&#x2F;p&gt;
&lt;p&gt;Such vast challenges are often obfuscated by the technical framework of our digital lives.&lt;&#x2F;p&gt;
&lt;p&gt;I find digital accessibility a hugely interesting area, one that I am just now starting to explore.&lt;&#x2F;p&gt;
&lt;p&gt;This is a work in progress. We have some interesting ideas and will present a conceptual prototype, come check again after March 6th, when the 2022 festival started. Or come to the official digital presentation for the bot.&lt;&#x2F;p&gt;
&lt;p&gt;This bot is my first paid software work and I am getting to work with several awesome people and teams to realize different parts of the project. Here, I am not responsible for anything in the Front end, the product you will interact with here is by no means finished and may not respond at times, since we are moving and restarting it for production purposes.
Nevertheless, all the intended core features of the bot are present and you can try it out there in the corner.
If you wish to see more of the realization process, the entire project is on a public GitHub and is intended to ship as open source.&lt;&#x2F;p&gt;
&lt;p&gt;In the final version (for now), every single sentence will be accompanied by a video in German Sign Language (DGS).
It can gracefully recover from some common input errors and can make live calls to external databases, displaying further information about all the events of the festival and teaching the Fingeralphabet. It supports free text input and is completely screen-reader compatible. It is scripted in easy language, to further facilitate access.
It is mostly context-aware and features quite a bit of dynamic content generated based on user input.&lt;&#x2F;p&gt;
&lt;p&gt;Have a look at the GitHub Repository here:
&lt;a rel=&quot;external&quot; href=&quot;https:&#x2F;&#x2F;github.com&#x2F;arontaupe&#x2F;KommunikationsKrake&quot;&gt;Check out the Repo&lt;&#x2F;a&gt;&lt;&#x2F;p&gt;
&lt;p&gt;If Ällei is for some reason not present on the page here, check out the prototype page, also found in the GitHub Repo.&lt;&#x2F;p&gt;
&lt;p&gt;&lt;a rel=&quot;external&quot; href=&quot;https:&#x2F;&#x2F;arontaupe.github.io&#x2F;KommunikationsKrake&#x2F;&quot;&gt;Check out the prototype page&lt;&#x2F;a&gt;&lt;&#x2F;p&gt;
&lt;blockquote class=&quot;important&quot;&gt;
	&lt;p class=&quot;alert-title&quot;&gt;
		&lt;i class=&quot;icon&quot;&gt;&lt;&#x2F;i&gt;Important&lt;&#x2F;p&gt;
	&lt;p&gt;I regard accessibility as a core question of both design and computation, really making tangible the prestructured way of our interaction with technology in general.&lt;&#x2F;p&gt;

&lt;&#x2F;blockquote&gt;
&lt;p&gt;&lt;a rel=&quot;external&quot; href=&quot;https:&#x2F;&#x2F;www.sommerblut.de&#x2F;&quot;&gt;Check out the Sommerblut Website&lt;&#x2F;a&gt;&lt;&#x2F;p&gt;
&lt;blockquote class=&quot;note&quot;&gt;
	&lt;p class=&quot;alert-title&quot;&gt;
		&lt;i class=&quot;icon&quot;&gt;&lt;&#x2F;i&gt;Note&lt;&#x2F;p&gt;
	&lt;p&gt;Update: we now have a launch date, which will be held online. Further information can be found here:
&lt;a rel=&quot;external&quot; href=&quot;https:&#x2F;&#x2F;www.sommerblut.de&#x2F;ls&#x2F;veranstaltung&#x2F;875-allei&quot;&gt;Check out our Launch Event&lt;&#x2F;a&gt;&lt;&#x2F;p&gt;

&lt;&#x2F;blockquote&gt;
&lt;blockquote class=&quot;note&quot;&gt;
	&lt;p class=&quot;alert-title&quot;&gt;
		&lt;i class=&quot;icon&quot;&gt;&lt;&#x2F;i&gt;Note&lt;&#x2F;p&gt;
	&lt;p&gt;Update 2: The Chatbot is now online for a while already and finds itself in a &quot;public beta&quot;, so to speak, a phase where it can be used and evaluated by users and is collecting feedback. Also, since this is Google, after all, all the inputs are collected and then further used to improve weak spots in the architecture of the bot.
&lt;a rel=&quot;external&quot; href=&quot;https:&#x2F;&#x2F;chatbot.sommerblut.de&quot;&gt;Find the public Chatbot&lt;&#x2F;a&gt;&lt;&#x2F;p&gt;

&lt;&#x2F;blockquote&gt;
&lt;meta name=&quot;viewport&quot; content=&quot;width-device-width, initial-scale=1&quot;&gt;
&lt;script src=&quot;https:&#x2F;&#x2F;www.gstatic.com&#x2F;dialogflow-console&#x2F;fast&#x2F;messenger&#x2F;bootstrap.js?v=1&quot;&gt;&lt;&#x2F;script&gt;
&lt;p&gt;&amp;lt;df-messenger
chat-icon=&quot;&quot;
intent=&quot;WELCOME&quot;
chat-title=&quot;Ällei&quot;
agent-id=&quot;335d74f7-2449-431d-924a-db70d79d4f88&quot;
language-code=&quot;de&quot;&lt;&#x2F;p&gt;
&lt;blockquote&gt;
&lt;&#x2F;df-messenger&gt;
&lt;&#x2F;blockquote&gt;
</content>
        
    </entry>
    <entry xml:lang="en">
        <title>Chatbot</title>
        <published>2020-07-15T00:00:00+00:00</published>
        <updated>2020-07-15T00:00:00+00:00</updated>
        
        <author>
          <name>
            Aron Petau
          </name>
        </author>
        
        <link rel="alternate" type="text/html" href="https://aron.petau.net/project/chatbot/"/>
        <id>https://aron.petau.net/project/chatbot/</id>
        
        <content type="html" xml:base="https://aron.petau.net/project/chatbot/">&lt;h2 id=&quot;Guru_to_Go:_a_speech-controlled_meditation_assistant_and_sentiment_tracker&quot;&gt;Guru to Go: a speech-controlled meditation assistant and sentiment tracker&lt;&#x2F;h2&gt;
&lt;iframe
	class=&quot;youtube-embed&quot;
	src=&quot;https:&#x2F;&#x2F;www.youtube-nocookie.com&#x2F;embed&#x2F;R73vAH37TC0&quot;
	allow=&quot;accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share&quot;
	referrerpolicy=&quot;strict-origin-when-cross-origin&quot; allowfullscreen&gt;
&lt;&#x2F;iframe&gt;
&lt;p&gt;Here, you see a Demo video of a voice-controlled meditation assistant that we worked on in the course &quot;Conversational Agents and speech interfaces&quot;&lt;&#x2F;p&gt;
&lt;div class=&quot;buttons&quot;&gt;
  &lt;a class=&quot;colored external&quot; href=&quot;https:&#x2F;&#x2F;w3o.ikw.uni-osnabrueck.de&#x2F;scheinmaker&#x2F;export&#x2F;details&#x2F;76&#x2F;67&quot;&gt;Course Description&lt;&#x2F;a&gt;
&lt;&#x2F;div&gt;
&lt;p&gt;The central goal of the entire project was to make the Assistant be entirely speech controlled, such that the phone needn&#x27;t be touched while immersing yourself in meditation.&lt;&#x2F;p&gt;
&lt;p&gt;The Chatbot was built in Google Dialogflow, a natural language understanding engine that can interpret free text input and identify entities and intents within it,
We wrote a custom python backend to then use these evaluated intents and compute individualized responses.&lt;&#x2F;p&gt;
&lt;p&gt;The resulting application runs in Google Assistant and can adaptively deliver meditations, visualize sentiment history and comprehensively inform about meditation practices. Sadly, we used beta functionality from the older &quot;Google Assistant&quot; Framework, which got rebranded months after by Google into &quot;Actions on Google&quot; and changed core functionality requiring extensive migration that neither Chris, my partner in this project, nor I found time to do.&lt;&#x2F;p&gt;
&lt;p&gt;Nevertheless, the whole Chatbot functioned as a meditation player and was able to graph and store recorded sentiments over time for each user.&lt;&#x2F;p&gt;
&lt;p&gt;Attached below you can also find our final report with details on the programming and thought process.&lt;&#x2F;p&gt;
&lt;div class=&quot;buttons&quot;&gt;
  &lt;a class=&quot;colored external&quot; href=&quot;https:&#x2F;&#x2F;acrobat.adobe.com&#x2F;link&#x2F;track?uri=urn:aaid:scds:US:23118565-e24e-4586-b0e0-c0ef7550a067&quot;&gt;Read the full report&lt;&#x2F;a&gt;
&lt;&#x2F;div&gt;
&lt;div class=&quot;buttons&quot;&gt;
  &lt;a class=&quot;colored external&quot; href=&quot;https:&#x2F;&#x2F;github.com&#x2F;cstenkamp&#x2F;medibot_pythonbackend&quot;&gt;Look at the Project on GitHub&lt;&#x2F;a&gt;
&lt;&#x2F;div&gt;
&lt;blockquote class=&quot;note&quot;&gt;
	&lt;p class=&quot;alert-title&quot;&gt;
		&lt;i class=&quot;icon&quot;&gt;&lt;&#x2F;i&gt;Note&lt;&#x2F;p&gt;
	&lt;p&gt;After this being my first dip into using the Google Framework for the creation of a speech assistant and encountering many problems along the way that partly found their way also into the final report, now I managed to utilize these explorations and am currently working to create &lt;a href=&quot;&#x2F;allei&#x2F;&quot;&gt;Ällei&lt;&#x2F;a&gt;, another chatbot with a different focus, which is not realized within Actions on google, but will rather be getting its own react app on a website.&lt;&#x2F;p&gt;

&lt;&#x2F;blockquote&gt;
</content>
        
    </entry>
</feed>
