Finalized the flow of the application and the data that has to be displayed
Interaction with HoloLens device and Unity
Designing UI for the application
Start designing in Enklu along with Unity
Designed a basic interface in Unity (by Victor)
Hurdles
Setup of lab machines for HoloLens (additional installation of UWP)
Setup of Enklu installed HoloLens and credentials for Enklu online editor
Next steps
Getting started with Enklu online editor and setting up HoloLens
Refine user interface
Week 2 update
Progress
Development a basic prototype with Unity
Development of the team’s blog website
Hurdles
Starting up of HoloLens with Enklu setup
A prototype created on Enklu and deployed on the Hololens did not render and displayed a blank screen
Next steps
Designing the face recognition algorithm
Designing the vulnerability score algorithm
Categorize the parameters to be displayed
Week 3 update
Progress
The team started learning Unity
Designed a basic face recognition algorithm
Designed a basic vulnerability score algorithm
Categorizing data according to hierarchy such as: Social media info, Personal info, financial info, interests and connection info
Hurdles
Converting unity prefabs to .obj and .fbx, for importing the same in Enklu
Enklu protoype not compatible with Unity and vice versa. Communicated concerns with TA and Professor and got a thumbs up to go ahead for working directly with Unity
Need a machine with UWP installed in the Unity with admin access
Next steps
Implementation of the face recognition algorithm
Implementation of the vulnerability score algorithm
Week 4 update
Progress
Have a basic wireframe ready as prototype
Researched on assets to be used
Implementation of the face recognition algorithm
Implemented the vulnerability score algorithm
Setup of collab
Worked on parsing the data to be displayed in unity.
Hurdles
Unsuccessful in aquiring windows machines with UWP installed.
Next steps
Refine user interface
Work on basic wireframe integration along with the assets bought online
Integration of vulnerability score algorithm
Continue on implementation of the face recognition algorithm
Week 5 update
Progress
Implemented the vulnerability score algorithm
Continuing development on the UI
Work on basic wireframe integration
Created an api endpoint to detect photos
Created an api endpoint to train faces
Hurdles
Face recognition api integration with the hololens
Next steps
Implementing gaze interface
Week 6 update
Progress
Integration of the back end information to render on the UI
Facial recognition for detecting faces is built
Implemented navigation bar in every category screen
Integerated gaze interface (viewing 3 seconds on a screen/button interaction)
Created an api endpoint to train faces
Hurdles
Implementing the gaze interface
Implementation and integration of facial recognition
Next steps
Implement visual cues in initial camera interface
Create Application splash screen
Incorporate voice commands
Include profile data for rest of the team members
Week 7 update
Progress
Integration of facial recognition with existing Unity code
Voice commands for interaction with the application
Researched information from various sources like LinkedIn, Facebook, Venmo, piple.com, Beenverified.com
Implemented redirection to social media profiles
Hurdles
Incompatible Unity version for facial recognition encountered
Next steps
Training the facial recognition model for team members
Creating a system architecture documentation
Different color indications for range of vulnerability scores
Week 8 update
Progress
Trained model for facial recognition
Created a system architecture documentation
Implemented color indication for vulnerability score
Hurdles
Stabalizing the screen movements to a fixed distance from the user
Next steps
Complete Gods Eye website
Design document creation
Week 9 update
Progress
Stabalizing application along elliptical axis rather than orbital axis
Gods Eye Website is complete
Hurdles
Not able to hit api endpoint for Azure api due to trial account expiration
Next steps
Record trailer and demo video of Gods Eye for final presentation
Create new account for azure api and integrating it with code
Week 10 update
Progress
Created new Azure account with face recognition API, updated the endpoint and key