1. class
  2. Biigle
  3. \
  4. Jobs
  5. \
  6. ProcessAnnotatedFile

ProcessAnnotatedFile

abstract class ProcessAnnotatedFile extends GenerateFeatureVectors

Traits

SerializesModels
InteractsWithQueue
Queueable
Dispatchable

Properties

int $maxRedispatchTries

The maximum number of times the job may be redispatched.
int $tries

The number of times the job may be attempted.
protected bool $deleteWhenMissingModels

Ignore this job if the annotation does not exist any more.

Methods

array
getAnnotationBoundingBox(array $points, Shape $shape, int $pointPadding = 112, int $boxPadding = 0, int $minSize = 32)

Get the bounding box of an annotation

from  GenerateFeatureVectors
array
ensureBoxAspectRatio(array $box, int $aspectWidth, int $aspectHeight)

Modify a bounding box so it adheres to the aspect ratio given by width and height.

from  GenerateFeatureVectors
makeBoxContained(array $box, int|null $maxWidth, int|null $maxHeight)

Adjust the position and size of the box so it is contained in a box with the given dimensions.

from  GenerateFeatureVectors
array
getPointBoundingBox(array $points, int $padding)

Get the bounding box of a point annotation.

from  GenerateFeatureVectors
array
getCircleBoundingBox(array $points)

Get the bounding box of a circle annotation.

from  GenerateFeatureVectors
array
getPolygonBoundingBox(array $points)

Get the bounding box of an annotation that is no point, circle or whole frame.

from  GenerateFeatureVectors
array
makeBoxIntegers(array $box)

Round and cast box values to int.

from  GenerateFeatureVectors
array
generateInput(array $files, array $paths, Collection $annotations)

Generate the input for the python script.

from  GenerateFeatureVectors
array
generateFileInput(VolumeFile $file, Collection $annotations)

No description

from  GenerateFeatureVectors
python(string $inputPath, string $outputPath)

Run the Python command.

from  GenerateFeatureVectors
Generator
readOutputCsv(string $path)

Generator to read the output CSV row by row.

from  GenerateFeatureVectors
__construct(VolumeFile $file, array $only = [], bool $skipPatches = false, bool $skipFeatureVectors = false, bool $skipSvgs = false, string|null $targetDisk = null, int $redispatchTries = 0)

Create a new job instance.

static string
getTargetPath(Annotation $annotation, string|null $format = null)

Assemble the target path for an annotation patch.

void
handle()

Execute the job.

handleFile(VolumeFile $file, string $path)

Handle a single file.

bool
shouldGiveUpAfterException(Exception $e)

Determine if the job should give up trying because the error will likely not be fixed the next time.

bool
shouldRetryAfterException(Exception $e)

Determine if this job should retry instead of fail after an exception

void
createSvgs()

Generate and upload annotation SVGs for the file.

void
createSvg(Annotation $annotation)

Generate and upload an SVG for the annotation.

string
getAnnotationPatch(Image $image, array $points, Shape $shape)

Get the annotation patch as buffer.

void
generateFeatureVectors(Collection $annotations, array|string $filePath)

Generates feature vectors for the specified annotations belonging to the file of this job. This method either creates new feature vector models or updates the existing ones for the annotations.

void
updateOrCreateFeatureVectors(Collection $annotations, Generator $output)

Create the feature vectors based on the Python script output.

Builder
getAnnotationQuery(VolumeFile $file)

Get the query builder for the annotations (maybe filtered by IDs).

SVGNodeContainer
getSVGAnnotation(array $points, Shape $shape)

Draw annotation as SVG

SVGRect
getRectangleSvgAnnotation(array $tuples)

Get an SVG rectangle element.

SVGEllipse
getEllipseSvgAnnotation(array $tuples)

Get an SVG ellipse element.

float
computeRotationAngle(array $v, array $u)

Computes angle between two vectors

array
getOrientedCoordinates(array $tuples, Shape $shape)

Determines position of coordinate

void
redispatch()

Dispatch a copy of this job with a delay.

Details

in GenerateFeatureVectors at line 21
array getAnnotationBoundingBox(array $points, Shape $shape, int $pointPadding = 112, int $boxPadding = 0, int $minSize = 32)

Get the bounding box of an annotation

Parameters

array $points
Shape $shape
int $pointPadding

The default is half the patch size of 224 that is expected by DINO.
int $boxPadding
int $minSize

Each side of the box should have at least this number of pixels. Must be divisible by 2.

Return Value

array

in GenerateFeatureVectors at line 70
array ensureBoxAspectRatio(array $box, int $aspectWidth, int $aspectHeight)

Modify a bounding box so it adheres to the aspect ratio given by width and height.

Parameters

array $box
int $aspectWidth
int $aspectHeight

Return Value

array

in GenerateFeatureVectors at line 108
makeBoxContained(array $box, int|null $maxWidth, int|null $maxHeight)

Adjust the position and size of the box so it is contained in a box with the given dimensions.

Parameters

array $box
int|null $maxWidth
int|null $maxHeight

in GenerateFeatureVectors at line 134
protected array getPointBoundingBox(array $points, int $padding)

Get the bounding box of a point annotation.

Parameters

array $points
int $padding

Return Value

array

in GenerateFeatureVectors at line 147
protected array getCircleBoundingBox(array $points)

Get the bounding box of a circle annotation.

Parameters

array $points

Return Value

array

in GenerateFeatureVectors at line 160
protected array getPolygonBoundingBox(array $points)

Get the bounding box of an annotation that is no point, circle or whole frame.

Parameters

array $points

Return Value

array

in GenerateFeatureVectors at line 180
protected array makeBoxIntegers(array $box)

Round and cast box values to int.

Parameters

array $box

Return Value

array

in GenerateFeatureVectors at line 194
protected array generateInput(array $files, array $paths, Collection $annotations)

Generate the input for the python script.

Parameters

array $files

VolumeFile instances of the files to which the annotations belong.
array $paths

Paths of locally cached files.
Collection $annotations

Annotations grouped by their file ID (e.g. image_id).

Return Value

array

in GenerateFeatureVectors at line 211
protected array generateFileInput(VolumeFile $file, Collection $annotations)

No description

Parameters

VolumeFile $file
Collection $annotations

Return Value

array

in GenerateFeatureVectors at line 246
protected python(string $inputPath, string $outputPath)

Run the Python command.

Parameters

string $inputPath
string $outputPath

in GenerateFeatureVectors at line 262
protected Generator readOutputCsv(string $path)

Generator to read the output CSV row by row.

Parameters

string $path

Return Value

Generator

at line 78
__construct(VolumeFile $file, array $only = [], bool $skipPatches = false, bool $skipFeatureVectors = false, bool $skipSvgs = false, string|null $targetDisk = null, int $redispatchTries = 0)

Create a new job instance.

Parameters

VolumeFile $file

The file to process.
array $only

If filled with annotation IDs belonging to the file, only the annotations will be processed.
bool $skipPatches

Disable generation of annotation patches.
bool $skipFeatureVectors

Disable generation of annotation feature vectors.
bool $skipSvgs

Disable generation of annotation SVGs.
string|null $targetDisk

The storage disk to store annotation patches to ( default is the configured largo.patch_storage_disk).
int $redispatchTries

Counter to track the number of attempted redispatches.

at line 93
static string getTargetPath(Annotation $annotation, string|null $format = null)

Assemble the target path for an annotation patch.

Parameters

Annotation $annotation
string|null $format

Return Value

string

at line 113
void handle()

Execute the job.

Return Value

void

at line 157
abstract handleFile(VolumeFile $file, string $path)

Handle a single file.

Parameters

VolumeFile $file
string $path

Path to the cached file.

at line 165
protected bool shouldGiveUpAfterException(Exception $e)

Determine if the job should give up trying because the error will likely not be fixed the next time.

Parameters

Exception $e

Return Value

bool

at line 196
protected bool shouldRetryAfterException(Exception $e)

Determine if this job should retry instead of fail after an exception

Parameters

Exception $e

Return Value

bool

at line 216
void createSvgs()

Generate and upload annotation SVGs for the file.

Return Value

void

at line 227
protected void createSvg(Annotation $annotation)

Generate and upload an SVG for the annotation.

Parameters

Annotation $annotation

Return Value

void

at line 267
protected string getAnnotationPatch(Image $image, array $points, Shape $shape)

Get the annotation patch as buffer.

Parameters

Image $image
array $points
Shape $shape

Return Value

string

at line 299
protected void generateFeatureVectors(Collection $annotations, array|string $filePath)

Generates feature vectors for the specified annotations belonging to the file of this job. This method either creates new feature vector models or updates the existing ones for the annotations.

Parameters

Collection $annotations
array|string $filePath

If a string, a file path to the local image to use for feature vector generation. If an array, a map of annotation IDs to a local image file path.

Return Value

void

at line 359
abstract protected void updateOrCreateFeatureVectors(Collection $annotations, Generator $output)

Create the feature vectors based on the Python script output.

Parameters

Collection $annotations
Generator $output

Return Value

void

at line 366
abstract protected Builder getAnnotationQuery(VolumeFile $file)

Get the query builder for the annotations (maybe filtered by IDs).

Parameters

VolumeFile $file

Return Value

Builder

at line 377
protected SVGNodeContainer getSVGAnnotation(array $points, Shape $shape)

Draw annotation as SVG

Parameters

array $points

one dimensional array filled with coordinates of annotation
Shape $shape

shape of given annotation

Return Value

SVGNodeContainer

annotation as SVG

at line 432
protected SVGRect getRectangleSvgAnnotation(array $tuples)

Get an SVG rectangle element.

Parameters

array $tuples

Return Value

SVGRect

at line 453
protected SVGEllipse getEllipseSvgAnnotation(array $tuples)

Get an SVG ellipse element.

Parameters

array $tuples

Return Value

SVGEllipse

at line 481
protected float computeRotationAngle(array $v, array $u)

Computes angle between two vectors

Parameters

array $v

first vector
array $u

second vector

Return Value

float

rotation angle in degree *

at line 512
protected array getOrientedCoordinates(array $tuples, Shape $shape)

Determines position of coordinate

Parameters

array $tuples

coordinates array
Shape $shape

shapeId of given annotation

Return Value

array

with coordinates assigned to their position on the plane

at line 538
protected void redispatch()

Dispatch a copy of this job with a delay.

Return Value

void