Accessing metadata of an extent (data shard) - azure-data-explorer

I am trying to understand anatomy of an extent. Is there any admin command or tool to display metadata of an extent ? There is a .show table <tablename> extents command but it doesn't display all the metadata information that the documentation says extents store.

This information exists but as an internal implementation detail and is not exposed publicly. If you have specific questions please update your question to be more specific and we will be happy to answer.

Related

Airflow map all tasks dependencies

I'm trying to find a way to extract all tasks dependencies. The idea is to find all SQL tasks (Bigquery) and find all it depending tables so i guess there is sort of a metadata db or another option i could think of is reading the "Render" (render template) code and extract the different entities straight from there but can't find any data source which holds that data.
I'm. trying to find a relevant data source / access which holds that info. Any idea how and where i can find it ?
Thanks

guidance needed for corda Application design

I have a web background majorly with javascript, I have started learning Corda recently for project implementation and need guidance in this regard,
So our application is based on the web, the user signs up with different school name, create question papers, and then want to share either part of it or whole with teachers of some other school in our platform. they can make changes and assign it back to creator and the process goes back and forth, finally signing the paper to be finalized, once finalized it cannot be changed by anyone. I need to store these transactions in Corda application, not sure how to go about it, I did try replicating it using negotiation application in corda/kotlin/sample, but stuck in a bug as I was trying to send a list of objects.
I do have the following questions in mind
Should I use enterprise edition or go with open source as I think I need schema design for this. web db is in postgress
As far as I have seen each node is predefined in the config with username and password,is there a way to create the node while the user signs up.
I have schools and teachers inside the school, do I need a separate node for each school and then create states in each node(not sure if a node can be set up at run time). or do I use the account's library provided for creating the account of each teacher, if yes id there a way to use passwords in it, unable to find password field in it.
how do I send an array of objects to the state, or should I create a separate state for each question, as different questions can be assigned to different teachers, but again multiple questions can be assigned to the same teacher.
These are few questions on my mind any help is much appreciated, as most of the examples gave IOU samples or states with int and string, Please guide me in the right direction.
Alessandro has good advice here, definitely look at the samples repos for inspiration on how to build what you're looking for.
start with open source, it's easier to prototype and you can switch to enterprise later it won't be an issue for you
this depends on design, you wouldn't really want to create a new corda node per-person, you might want to have corda accounts that run on a single node instead. See accounts sdk here: https://github.com/corda/accounts
what you might do is make a corda node for each school and then accounts per teacher like you were already were thinking. That would mean only a couple of nodes based on the number of schools you have.
as long as your state is marked with #CordaSerializable you won't have problems sending arrays of data, I send an array in a state in this sample here: https://github.com/corda/samples-java/blob/master/Advanced/secretsanta-cordapp/contracts/src/main/java/net/corda/samples/secretsanta/states/SantaSessionState.java#L24
https://github.com/corda/samples-java
https://github.com/corda/samples-kotlin

How to search the internet for pages containing specified terms and storing the results in a data table, from within R, using OpenSearch

I am setting up a database of certain events that have occurred in the past, and need to search the internet for a number of terms to retrieve as many pages as possible that contain terms related to the happenings i want to document.
First I looked into achieving this using Googles "Custom Search API", after reading this question:
Need to access Google Custom search api through R
I did manage to get a JSON of search results through the browser, but not through R, so I moved on.
When I saw that the Custom Search API was using OpenSearch, and found the rOpenSearch package for R, I wanted to try going down this path:
http://terradue.github.io/rOpenSearch/
After reading through the documentation, there was only provided examples of searching sites that provide opensearch descriptions. As I need to search as many websites as possible, it seems like I would need an opensearch description for a search engine like Google. But I can't seem to find that anywhere.
Is there any way to search the internet via. R using OpenSearch, and collecting the results in a data table?
If you know of a better solution to my problem, I'd appreciate if you could point me in another direction.
If I read well, you are looking for something called Web Scraping via R.
<See me!>

Concrete5 Stacks & Blocks

I am working on existing concrete5 website and I don't have sufficient knowledge of concrete database structure.
I am creating api to fetch all the products which are added in "Stacks and Blocks".
I have cID, stID values and fetched the info from stacks table, Can anyone please let me know How to fetch the complete details including image from database.
I tried to make the relation between tables based on cID, stID.
Thanks in advance.
The images are stored in the application/files directory although you'll need to retrieve the path from the database to find them. as #1stthomas noted, without more details of the information you are working with, it's difficult to provide any specific advice.
FWIW, the API documentation for concrete5 can be found here.

How to provide access to new user to "Custom Query" data source in Data Studio?

I use data studio for reporting by connecting to BigQuery as a data source via 'Custom Query'.But the issue is I am the only one who can edit these data sources/queries.
I have contacted google support and they told only owner can edit/access the data source.
According, to below link the only owner can edit/access the data source :
https://support.google.com/datastudio/answer/7083608?hl=en
So, Could you please suggest on below if you also have faced a similar issue :
How to provide 'Edit' access to use other than owner for editing the 'Custom Query'?
If it is not possible what can be the alternative or best practice so that we both can see and edit 'Custom Query'.
Because it is strange what will happen if I will leave the company.if you faced the same issue what you did?
Thanks a lot in advance.
You can share the Data Source with relevant users with Edit access. That way they can also edit the Query.
As of the February 11th 2021 release, the way this works has now changed.
Data sources created while editing a report will be considered 'embedded' and the source will be fully editable (including the source connection, for example a custom query) by all editors of the report.
Data sources created from the main DataStudio menu will be considered 'reusable' and will have a specific owner (the person who created the source, or anyone they transferred ownership to). Reusable sources can then be used in multiple different reports.

Resources