Artek — Placing Artwork in AR

Our client’s startup revolves around an innovative iOS app designed for artists, curators, galleries, and institutions to view, organize, and share artworks. Our primary mission was to integrate AR functionality to allow users to place artworks within interior settings effectively.

Initially, we tackled the core AR functionality by developing a ‘finger following’ mechanic, where the artwork moves in sync with the user’s finger when pressed and held. This update included refining the focus entity, significantly reducing memory consumption and preventing app crashes. Our efforts extended into enhancing the end-to-end user experience (UX).

Following this, we dedicated several weeks to architectural refinements, which resulted in faster performance, smoother operation, and reduced RAM usage. A considerable amount of time was also spent debugging issues related to disappearing AR models and crashes that occurred during the creation, updating, or deletion of artwork—especially when these actions were interrupted by network requests.

Key Features Implemented:

• AR Camera Screen: Displays the artwork AR model for placement.
• Artwork Placement Options: Users can place artworks using floor markers, wall, or wall markers.
• Interactive Controls: Includes a lock button to secure artwork to a wall and directional controls to adjust the artwork’s position.
• Guidance System: A coaching overlay instructs users on device movement to locate anchors or use their finger to position the artwork.
• App Clip Integration: Features a selected artwork and details about its owner, with direct access to the AR screen.
• Visual Enhancements: Flash animation for capturing photos within the AR view.
• Photo Editing Tools: Standard editing features such as cropping, rotating, and painting.
• Dynamic Reanchoring: Facilitates reanchoring when a model’s anchor is removed from the scene.
• Advanced Collection Management: Allows for the organization of artworks into collections and sub-collections, which can also be shared and accessed through the app or an app clip.