AI-Assisted Video Captioning and Editing for Community Events

What it is for

Inform

The system produces post-event recap videos and highlight reels for public information and community outreach, with AI-generated captions to improve accessibility.

NYC Algorithmic Tools Compliance Report

Accessibility

AI-generated captions (auto-subtitles) are produced for all exported videos, improving accessibility for viewers who are deaf or hard of hearing.

NYC Algorithmic Tools Compliance Report

Run by: Department of Youth and Community Development (DYCD)
Where: No fixed location
Kept: Not stated by the NYC Office of Technology and Innovation.
Shared with: Not stated by the NYC Office of Technology and Innovation.

What it is for

Inform

Accessibility

Adobe Premiere Pro is used by the NYC Department of Youth and Community Development to edit post-event recap videos and highlight reels, using AI to automatically generate subtitles. The tool processes uploaded video files and exports finished videos with captions, music, and professional edits. It affects members of the public who appear in or view department communications videos. The AI captioning capability is proprietary to Adobe and the underlying training data is not publicly disclosed.

What it collects and what happens to it

Data taken in

Biometric

Identifiable data

Video files uploaded for editing contain audio of individuals speaking at events (voices), and may contain visual footage of identifiable individuals participating in DYCD community events.

NYC Algorithmic Tools Compliance Report

Operational data

Anonymized data

Raw video files from community events are uploaded to the software for clipping, cutting, and editing into a final highlight reel or recap video.

NYC Algorithmic Tools Compliance Report

Processing

Speech & Audio

The AI component uses speech-to-text transcription to convert spoken audio in event videos into auto-generated subtitle captions embedded in the exported video.

NYC Algorithmic Tools Compliance Report

What it does

Sensing (Perceptive AI)

Human decides

The AI processes audio from video files to transcribe speech into auto-generated subtitle captions. A human editor reviews and finalises the video; the AI captioning is informative and advisory in nature.

NYC Algorithmic Tools Compliance Report

Creating (Generative AI)

Human decides

The system generates subtitle text (captions) as new content overlaid on the video. The caption text is AI-created from speech; a human editor reviews the output before publication.

NYC Algorithmic Tools Compliance Report

Outputs

Generated content

Anonymized data

The system exports a finished video file with AI-generated subtitle captions, music, and professional editing applied. The captions are newly generated text content produced by the AI from the spoken audio.

NYC Algorithmic Tools Compliance Report

Run by

Department of Youth and Community Development (DYCD)

The Department of Youth and Community Development (DYCD) deploys Adobe Premiere Pro within its Communications unit to produce post-event recap videos and highlight reels for public outreach.

NYC Algorithmic Tools Compliance Report

Built by

Adobe

Adobe developed and maintains Premiere Pro, an off-the-shelf video editing software that includes AI-powered auto-subtitle captioning. Adobe holds the proprietary training data used for the captioning model.

NYC Algorithmic Tools Compliance Report

Kept for

Not stated by the NYC Office of Technology and Innovation.

Shared with

Not stated by the NYC Office of Technology and Innovation.

Stored

Not stated by the NYC Office of Technology and Innovation.

How to read the colours

Can it identify you?

Anonymized data: Data about people with the link to who is broken. Stripped of identifiers, blurred, aggregated, or noised so this system can’t reasonably tie a record back to an individual.
Pseudonymous data: Each person’s data is tied to a token (hash, ID, template) that lets this system recognise the same person across events, but the token itself doesn’t reveal a name. Reidentification is possible with extra information.
Identifiable data: The data either contains a direct identifier (name, address, account name, recognisable face or voice, plate number) or carries a token this system uses to look up legal identity during processing.

Who completes the loop?

Human decides: This mode suggests; a person decides what to do next. The AI is always advisory — a human is in the loop on every decision. Example: a triage tool ranks cases for a clinician who chooses which to see first.
Human executes: This mode decides; a person carries out the result. Example: an optimizer plans the day’s trash-collection routes, and drivers run them.
Autonomous: This mode decides and acts on its own. No person reviews each decision or carries out the resulting action.

Definitions from the DTPR standard. Amber is about your data, violet about who decides. The fuller the shape and the deeper the colour, the more identifying the data or the less a person is involved.

What you can do

Ask about this system

Questions go to the NYC Office of Technology and Innovation, not the vendor.

Your rights

Right to Algorithmic TransparencyThe NYC AI register discloses that this tool uses AI for auto-subtitle captioning. The underlying model and training data are proprietary to Adobe and are not publicly disclosed. Members of the public may consult the NYC Algorithmic Tools Compliance Report for general information about how the tool is used by the Department of Youth and Community Development.

Risks and safeguards

Societal & cultural harmAutomated speech-to-text captioning may produce errors, including mishearing names, technical terms, or accented speech, potentially misrepresenting speakers in public communications.Safeguard: the register describes the autonomy as 'Informative', meaning human editors review and can correct captions before publication. The tool is used weekly by Communications staff on a discretionary basis.