Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions Final Project/FinalProjectReadme
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
*** Final Files can be found here ***

https://github.com/mteresaparreira/Mobile_HRI_Lab_Hub/tree/main/Final_Project
Binary file added Final Project/MobileHRI2023_finalreport (1).pdf
Binary file not shown.
5 changes: 5 additions & 0 deletions Final_Project_Proposal/Readme.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@


# Link to submitted lab
https://github.com/mteresaparreira/Mobile_HRI_Lab_Hub/tree/main/Final_Project_Proposal

# Final Project Planning
**List the names and NetID for your partners here.**

Expand Down
576 changes: 0 additions & 576 deletions Lab0/Readme.md

Large diffs are not rendered by default.

Empty file added Lab0/__init__.py
Empty file.
Empty file added Lab0/hri_publisher.py
Empty file.
Empty file added Lab0/hri_subscriber.py
Empty file.
Empty file added Lab0/my_package
Empty file.
5 changes: 5 additions & 0 deletions Lab1/Readme.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,9 @@
# Link to submitted lab
https://github.com/mteresaparreira/Mobile_HRI_Lab_Hub/tree/main/Lab1

# Interaction First
**Pratul Tandon (pt347), Trevor Morcott (trm75), Maria Teresa Parreira (mb2554)**
** https://github.com/mteresaparreira/Mobile_HRI_Lab_Hub/tree/main/Lab1 **
\*\***List the names and NetID for your partners here.**\*\*

In this lab, you will modify a robotic creature (ConeBot) that is originally designed by [Dr. Rei Lee](https://infosci.cornell.edu/~reilee/), a friend of our lab. The [ConeBot](https://infosci.cornell.edu/~reilee/ConeBot/) is a shy robot that hides under a small traffic cone. It is adventuring the world by itself but hopes people don't notice it at all.
Expand Down
96 changes: 59 additions & 37 deletions Lab2/Readme.md
Original file line number Diff line number Diff line change
@@ -1,21 +1,6 @@
# Then Prototype the Robot
**List the names and NetID for your partners here.**

This week's lab is a continuation of the previous week. We explore the role of both *siting*--the location and activity--in interaction, as well as the *form and appearance* of the robot in the interaction.


## Prep

### For this lab, you will need:
1. Paper
2. Markers/ Pens
3. Scissors/Utility Knifes
4. Smart Phone -- The main required feature is that the phone needs to have a browser and display a webpage.
5. **Found objects and materials** -- You will have to costume your CloneBot so that it fits in the intended setting. These materials can include doll clothes, a paper lantern, a bottle, human clothes, a pillow case, etc. Be creative! We have fabric, just ask!




**Pratul Tandon (pt347), Trevor Morcott (trm75), Maria Teresa Parreira (mb2554)**

### Deliverables for this lab are:

Expand All @@ -26,7 +11,6 @@ This week's lab is a continuation of the previous week. We explore the role of b
4. Submit the items above in the lab2 folder of your class [Github page], either as links or uploaded files. Each group member should post their own copy of the work to their own Lab Hub, even if some of the work is the same from each person in the group.

### The Report
This README.md page in your own repository should be edited to include the work you have done (the deliverables mentioned above). Following the format below, you can delete everything but the headers and the sections between the **stars**. Write the answers to the questions under the starred sentences. Include any material that explains what you did in this lab hub folder, and link it in your README.md for the lab.

## Lab Overview
For this assignment, you are going to:
Expand All @@ -41,64 +25,102 @@ D) [Wizard the robot](#part-d-wizard-the-robot)

E) [Video record the interaction](#part-e-record)

Labs are due on Tuesdays before class. Make sure this page is linked to on your main class hub page.

## Part A. Provide Feedback
You and your teammates will be assigned lab 1 submissions from one other group. Go to their github pages, view their videos, and provide them with reactions, suggestions & feedback: explain to them what you saw happening in their video. Guess the scene and the goals of the character. Ask them about anything that wasn’t clear.

**Summarize feedback your feedback here.**
Feedback:
Might be important to think about how the robot may be perceived as dangerous depending on the situation - thinking about guard bot
Similar when they are there feels like they maybe should help (accident bot) - understand it can't but may impact perception if not made clear
Clear what each robot does and the purpose - not entirely what's the interaction with the person
Very impressed with high quality drawings
In the reflections, we would have liked to see more on what worked or didn't work in the videos. For instance, what felt awkward? How did they feel about the interactions?

## Part B. Site the interaction

Think about where the interaction you are prototyping is going to occur-- on a desk? on a floor? indoors? outdoors?

What other people and objects are in that space?
\*\***Sketch and/or take photos of the site(s) you are considering.**\*\*

What activities are going on in that space? What activity is the robot going to be involved in?
SassyBot is a mobile robot stylist. It provides advice and feedback on a fit for clients visiting a store. It can also be used as a personal stylist – so, instead of being store-adjacent, it would be person-adjacent. It takes into account personal preferences and different styles. Its mobility and sensors make it a valuable asset to the shopping experience.

\*\***Sketch and/or take photos of the site(s) you are considering.**\*\*
![bloomingdales](https://user-images.githubusercontent.com/62056130/218634565-2a5185c1-2909-4ddb-89ad-196866c99d8b.png)

Bloomingdales Fitting Room (on Roosevelt Island) or other clothing stores

\*\***Document the activities being considered.**\*\*

\*\***What issues or opportunties arise from the site and activities?**\*\*
SassyBot provides valuable advice for customers. It can react to customer fits, suggest alternatives, guide the client to the fitting room or across the store. We illustrate our ideas:

## Part C. Costume the robot
\*\***What issues or opportunities arise from the site and activities?**\*\*

Only now should you start worrying about what the device should look like. Develop one costume so that CloneBot can fit into it's setting.
Issues:
* How the robot will see the person
* How the robot will avoid other people
* Where the robot will be stowed and interact
* How to shoot and try the scene while respecting those in the store

Opportunities:
* Potentially ask real people
* See what the real dimensions of the room will be
* Explore opportunities to incorporate into existing features like the mirror

Think about the setting of the device: is the environment a place where the device could overheat? Is water a danger?
## Part C. Costume the robot

Only now should you start worrying about what the device should look like. Develop one costume so that CloneBot can fit into it's setting.
Think about the setting of the device: is the environment a place where the device could overheat? Is water a danger?
Pick one of the custumes and make it with paper or cardboard or any other material!

\*\***Include sketches of what your robot might look like here.**\*\*

\*\***Include photos of your custumed robot here.**\*\*
![Image from iOS](https://user-images.githubusercontent.com/62056130/218633133-2d665f44-fc0a-4ead-b31c-232310666733.jpg)
![0001](https://user-images.githubusercontent.com/62056130/218635376-4b5c20d2-8e47-4b32-be9b-e4e074b2e53a.jpg)
![0002](https://user-images.githubusercontent.com/62056130/218635410-3bc43166-993f-4020-8fac-d5f414c6cfb4.jpg)


\*\***Include photos of your costumed robot here.**\*\*

\*\***What concerns or opportunitities are influencing the way you've designed the robot to look?**\*\*
![IMG_2665](https://user-images.githubusercontent.com/62056130/218634323-c9046ff3-4aed-40e2-b35f-ade715a62e29.jpg)
![IMG_2667](https://user-images.githubusercontent.com/62056130/218634326-910613f7-164c-41fa-8e0a-44be183af64a.jpg)


\*\***What concerns or opportunities are influencing the way you've designed the robot to look?**\*\*

We wanted to convey that the robot was a qualified to comment on their fashion; this is conveyed by the robot itself having good fashion.
The robot had to feel approachable but also upscale and suitable to be found in a luxury store; humaneseque so that humans would feel it is qualified to comment on their clothing items.
Approachable, cute and assertive as it handles sensitive and personal moments / video.

## Part D. Wizard the Robot
Take a little time to set up the wizarding set-up that allows for someone to remotely control the robot while someone interacts with it. Hint: You can use Zoom to record videos, and you can pin someone’s video feed if that is the scene which you want to record.

\*\***Include your first attempts at recording the set-up video here.**\*\*

Now, hange the goal within the same setting, and update the interaction with the paper prototype.
![IMG_2660](https://user-images.githubusercontent.com/62056130/218634312-5c85c19c-4bf8-4d1d-9a67-415d1bb2dfcc.jpg)

https://user-images.githubusercontent.com/62056130/218634702-2cba9921-ba1a-4293-b5eb-a42b59ad8a76.MOV



\*\***Show the follow-up work here.**\*\*

We worked on the costume and tested the mobility of the robot.

## Part E. Record

\*\***Take videos of your prototyped interaction.**\*\*

\*\***Please indicate anyone you collaborated with on this Lab.**\*\*
Be generous in acknowledging their contributions! And also recognizing any other influences (e.g. from YouTube, Github, Twitter) that informed your design.
Videos:

* https://drive.google.com/file/d/1bNEm5A9bAg4D4mWtCYiNBxggJiruMrLF/view?usp=sharing
* https://drive.google.com/file/d/1T1b1bhXN4YpdWVYOtz7X_f2uslF33JUz/view?usp=sharing -- full interaction, on site

\*\***Please mention anyone else you collaborated with on this Lab.**\*\*


\*\***Document everything here. (Particularly, we would like to see the storyboard and video, although photos of the prototype are also great.)**\*\*

Labs are due on Tuesdays before class. Make sure this page is linked to on your main class hub page.

### Again, deliverables for this lab are:
Reflection

* On reflection it was very difficult to film in the store. This was due to the fact that the robot got in the way, others did not want a robot near their room while they were changing and the swinging doors would have decapitated Edna if she were not more visible.
* Additionally we noticed how you really wanted to feel seen by the robot and it was annoying if she passed judgment without a good look.
* It was also frustrating there was no way to interrogate the bots' decisions and ask why or why not they reacted a certain way.

0. Fill in the questions along the way!
1. photos of costumed robots
Expand Down
4 changes: 4 additions & 0 deletions Lab3/Readme.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
# Link to completed lab
https://github.com/mteresaparreira/Mobile_HRI_Lab_Hub/tree/main/Lab3


# Make the Robot Move
**List the names and NetID for your partners here.**

Expand Down
83 changes: 46 additions & 37 deletions Lab4/Readme.md
Original file line number Diff line number Diff line change
@@ -1,61 +1,61 @@
# Make the robot see
**List the names and NetID for your partners here.**

Pratul Tandon, Trevor Morcott, Maria Teresa
Build off of Lab 3 from last week. This week's material can be done rather quickly.


## Prep

### For this lab, you will need:
1. Your laptop
2. Pi Camera

### Before you come to the lab on Thursday, please do the following:
1. Install VNC viewer from [here](https://www.realvnc.com/en/connect/download/viewer/) if you haven't.

### Deliverables for this lab are:

0. A screenshot of the working VNC viewer with a working image view.

1. Answers to the reflection questions in Part D.

### The Report
This README.md page in your own repository should be edited to include the work you have done (the deliverables mentioned above). Following the format below, you can delete everything but the headers and the sections between the **stars**. Write the answers to the questions under the starred sentences. Include any material that explains what you did in this lab hub folder, and link it in your README.md for the lab.

## Lab Overview
For this assignment, you are going to:

A) [Connect your camera](#-a-connect-your-camera)

B) [Connect to your Pi (VNC Viewer)](#part-b-connect-to-your-pi-through-vnc-viewer)

C) [People Detection](#part-c-people-detection)

Labs are due on Tuesdays before class. Make sure this page is linked to on your main class hub page.

## Part A. Connect your camera
Plug in the Pi camera to your RPi.

## Part B. Connect to your Pi through VNC Viewer
Start VNC Viewer, if prompted to sign in, "select Use VNC without signing in" in the bottom.

In the text box "Enter a VNC Server address or search", type in `Your_RPi_IP:1` (e.g. `10.56.131.31:1`).
> When prompted "server not encrypted", click "continue"
<img src="Images/vnc_warning.jpg" width="300">

**Password**: `student`

You should now log in to your Pi through VNC Viewer.

> <img src="Images/vnc.jpg" width="300">

Open a terminal, install `libcamera-dev`.

```bash
sudo apt install libcamera-dev
```
> <img src="Images/terminal.jpg" width="300">

## Part C. People Detection
First, let's test if your camera is working properly.
```bash
Expand All @@ -66,31 +66,40 @@ python3 test_camera.py
```
**Please include a screenshot of the working VNC viewer with a working image view.**

This exercise is based on this [The Data Frog Tutorial](https://thedatafrog.com/en/articles/human-detection-video/#:~:text=People%20detection,work%20well%20in%20other%20cases.) online. Your CPU will get toasty, so put on a **heat sink**.
![IMG_4621](https://user-images.githubusercontent.com/112022260/221882411-b3c506f1-0aa3-437f-957a-3d6a552c385d.jpg)

This exercise is based on this [The Data Frog Tutorial](https://thedatafrog.com/en/articles/human-detection-video/#:~:text=People%20detection,work%20well%20in%20other%20cases.) online. Your CPU will get toasty, so put on a **heat sink**.
```
# In a terminal in VNC Viewer
curl -LJO https://raw.githubusercontent.com/FAR-Lab/Mobile_HRI_Lab_Hub/main/Lab4/people_detection.py
python3 people_detection.py
```

Optional: Another example you can try is from [PyTorch](https://pytorch.org/tutorials/intermediate/realtime_rpi.html) (installed already on your system). You will need to write a few lines of code to load the labels yourself.

## Part D. Reflection

Reflect on the following questions:

1. For your favorite prototyped interaction that you have thought of so far, reflect upon how a camera connected to your Pi could be useful.
One of our prototyped interactions was the TrippingBot, a robot that trips near people, so we control for how people react when they see a robot "failing". A camera, in particular a camera with a person detection, would help automatize the system, as people near to be in the surroundings of the robot in order to notice the tripping action and, potentially, feel compeled to intervene. Also, a camera would be a pivotal part of the data collection process - we would collect RGB videos of the interactions and perform an ethnographic analysis.
2. What issues do you foresee with this setup?
Image processing is very slow. This would constitute a significant limitation for controlling the robot. Aditionally, as we're planning to run the study "in the wild", rather than a lab environment, variables such as lighting and internet connection will play a role in hindering optimal data collection conditions.
3. How is the temperature? How is the speed? How is the connection?
Very high temperature, very low speed, good connection but we don't foresee such good connection when running a study.
4. How is the view? Would it capture what you might need to see for your prototyped interaction (in question 1)?


We were unable to detect people. We will probably need higher processing abilities for out final robot.
Labs are due on Tuesdays before class. Make sure this page is linked to on your main class hub page.

### Again, deliverables for this lab are:

0. A screenshot of the working VNC viewer with a working image view.

1. Answers to the reflection questions in part D.

0. A screenshot of the working VNC viewer with a working image view
7 changes: 7 additions & 0 deletions Lab5/Readme.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,10 @@
# Link to finished lab
https://github.com/mteresaparreira/Mobile_HRI_Lab_Hub/tree/main/Lab5





# Give the robot moves
**List the names and NetID for your partners here.**

Expand Down
4 changes: 4 additions & 0 deletions Lab6/Readme.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
# Link to Lab Submissionn

https://github.com/mteresaparreira/Mobile_HRI_Lab_Hub/tree/main/Lab6

# Choreographing Movement
**List the names and NetID for your partners here.**

Expand Down
5 changes: 5 additions & 0 deletions Lab7/Readme.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
# Link to lab submissionn

https://github.com/mteresaparreira/Mobile_HRI_Lab_Hub/tree/main/Lab7


# Interact with with people + chatty robot


Expand Down