Skip to main content

Extractors

Meteor currently supports metadata extraction on these data sources. To perform extraction on any of these you need to create a recipe file with instructions as mentioned here. In the sample-recipe.yaml add source information such as type from the table below and config for that particular extractor can be found by visiting the link in the type field.

Extractors Feature Matrix​

Table​

TypeAttributesProfileSchemaLineageOwnershipCustom
clickhouse✅✅✅✗✗✗
couchdb✅✅✅✗✗✗
mongodb✅✅✗✗✗✗
mssql✅✅✅✗✗✗
mysql✅✅✅✗✗✗
postgres✅✅✅✗✗✗
cassandra✅✅✅✗✗✗
oracle✅✅✅✗✗✗
mariadb✅✅✅✗✗✗
redshift✅✅✅✗✗✗
presto✅✅✅✗✗✗
snowflake✅✅✅✗✗✗
bigquery✅✅✅✗✗✗
maxcompute✅✅✅✗✗✗

Dashboard​

TypeUrlChartLineageTagsCustom
grafana✅✅✗✗✗
metabase✅✅✗✗✗
superset✅✅✅✗✗
tableau✅✅✅✗✗
redash✅✗✗✗✗

Topic​

TypeProfileSchemaOwnershipLineageTagsCustom
kafka✗✗✗✗✗✗

User​

TypeEmailUsernameFullNameTitleIsActiveManagerEmailProfilesMembershipsfacetscommon
github✅✅✅✗✅✗✗✗✗✗
shield✅✅✅✗✅✗✗✅✅✗
gsuite✅✗✅✗✅✅✗✗✗✗

Bucket​

TypeLocationStorageTypeBlobsOwnershipTagsCustomTimestamps
gcs✅✅✗✅✅✗✅

Job​

TypeOwnershipUpstreamsDownstreamsCustom
optimus✅✅✅✅

Machine Learning Feature Table​

TypeOwnershipUpstreamsDownstreamsCustom
caramlstore✗✅✗✅

Application​

TypeOwnershipUpstreamsDownstreamsCustom
application_yaml✅✅✅✅

Machine Learning Model​

TypeOwnershipUpstreamsDownstreamsCustom
merlin✅✅✗✅

Generic​

These are special type of extractors that are capable of extracting any type of asset.

TypeOwnershipUpstreamsDownstreamsCustom
http✅✅✅✅