BioFSharp.INSDC.Crawler 0.2.1

.NET 8.0 This package targets .NET 8.0. The package is compatible with this framework or higher.
There is a newer version of this package available.
See the version list below for details. 
dotnet add package BioFSharp.INSDC.Crawler --version 0.2.1
                    


                    

                
NuGet\Install-Package BioFSharp.INSDC.Crawler -Version 0.2.1
This command is intended to be used within the Package Manager Console in Visual Studio, as it uses the NuGet module's version of Install-Package. 
<PackageReference Include="BioFSharp.INSDC.Crawler" Version="0.2.1" />
For projects that support PackageReference, copy this XML node into the project file to reference the package. 
<PackageVersion Include="BioFSharp.INSDC.Crawler" Version="0.2.1" />
                    


                            Directory.Packages.props
                        

                    

                
<PackageReference Include="BioFSharp.INSDC.Crawler" />
                    


                            Project file
For projects that support Central Package Management (CPM), copy this XML node into the solution Directory.Packages.props file to version the package. 
paket add BioFSharp.INSDC.Crawler --version 0.2.1
                    


                    

                
#r "nuget: BioFSharp.INSDC.Crawler, 0.2.1"
#r directive can be used in F# Interactive and Polyglot Notebooks. Copy this into the interactive tool or source code of the script to reference the package. 
#:package BioFSharp.INSDC.Crawler@0.2.1
#:package directive can be used in C# file-based apps starting in .NET 10 preview 4. Copy this into a .cs file before any lines of code to reference the package. 
#addin nuget:?package=BioFSharp.INSDC.Crawler&version=0.2.1
                    


                            Install as a Cake Addin
                        

                    

                
#tool nuget:?package=BioFSharp.INSDC.Crawler&version=0.2.1
                    


                            Install as a Cake Tool

BioFSharp.INSDC.Crawler

Collects INSDC (International Nucleotide Sequence Database Collaboration) records from the ENA public archive, as part of the BioFSharp.INSDC suite.

Given a single project accession, the crawler discovers every run, experiment, sample, and study connected to it, fetches the corresponding records from ENA, and persists them — together with the cross-reference graph that links them — through the BioFSharp.INSDC.SQLite store. The result is a local, queryable snapshot of a complete study assembled from one starting accession.

Because it performs live HTTP, this package targets .NET 6+ (net8.0) rather than the netstandard2.0 baseline of the rest of the suite.

Part of BioFSharp.INSDC. Released under the MIT license.

Product Compatible and additional computed target framework versions.
.NET net8.0 is compatible.  net8.0-android was computed.  net8.0-browser was computed.  net8.0-ios was computed.  net8.0-maccatalyst was computed.  net8.0-macos was computed.  net8.0-tvos was computed.  net8.0-windows was computed.  net9.0 was computed.  net9.0-android was computed.  net9.0-browser was computed.  net9.0-ios was computed.  net9.0-maccatalyst was computed.  net9.0-macos was computed.  net9.0-tvos was computed.  net9.0-windows was computed.  net10.0 was computed.  net10.0-android was computed.  net10.0-browser was computed.  net10.0-ios was computed.  net10.0-maccatalyst was computed.  net10.0-macos was computed.  net10.0-tvos was computed.  net10.0-windows was computed. 
Compatible target framework(s)
Included target framework(s) (in package)
Learn more about Target Frameworks and .NET Standard.

NuGet packages

This package is not used by any NuGet packages.

GitHub repositories

This package is not used by any popular GitHub repositories.

Version Downloads Last Updated
0.3.0 102 8/28/2026
0.2.1 133 7/9/2026
0.2.0 120 7/9/2026

Crawler fixes surfaced by large-scale crawls (incl. ENA umbrella projects such as `PRJNA9506`, which fans out to thousands of child projects).
- **BioFSharp.INSDC.Crawler** — a project/study with no sequencing runs now persists its own record: discovery is run-driven, so a childless root previously discovered nothing (not even itself). `Discovery.withRoot` seeds the root into the bucket its accession prefix implies (`PRJ…` → BioProject, `SRP`/`ERP`/`DRP…` → Study).
- **BioFSharp.INSDC.Crawler** — new `Started` crawl event, emitted before discovery, so the first log line identifies the root accession rather than only learning it at `done —`.
- **BioFSharp.INSDC.SQLite / Crawler** — bulk insert: `Sql.withTransaction` is now reentrant (a nested call joins the active transaction rather than throwing, since SQLite has no nested transactions), letting the crawler persist an entire crawl in a single transaction instead of one commit per record — the difference between a trickle and a bulk load on crawls of hundreds of thousands of runs.