Question:- What is autoscaling in Azure Databricks?
Answer:- Autoscaling is a feature of Databricks that help you to automatically scale your cluster up or down based on your needs. This can save you time and money.
Question:- What are some common issues with Azure Databricks?
Answer:-
1- Cluster creation failures: This can happen if you don’t have enough credits or if your subscription doesn’t allow for more clusters.
2- Spark errors: Spark errors throw if you’re using an unsupported version of Spark or if your code is incompatible with the Databricks runtime.
3- Network errors: Network errors can occur if there’s a problem with your network configuration or if you’re trying to access Databricks from an unsupported location.
Question:- What languages can be used in Azure Databricks?
Answer:- You can use any language that is supported by the Apache Spark platform, including Python, Scala, and R. you can also use SQL with Azure Databricks.
Question:- Can you use PowerShell to administer Databricks?
Answer:- No, you cannot use PowerShell to administer Databricks. You can use the Azure portal, Azure CLI, or Databricks REST API.
Question:- What is the difference between an instance and a cluster in Databricks?
Answer:- An instance is a virtual machine (VM) that runs the Databricks runtime. A cluster is a group of instances that are used to run Spark applications.
Question:- Can you cancel an ongoing job in Databricks?
Answer:- Yes, you can cancel an ongoing job in Databricks by clicking on the job in the Jobs page and then selecting Cancel Job from the drop-down menu.
Question:- What is the delta table in databricks?
Answer:- A delta table is a type of table that stores data in the Databricks Delta format. Delta tables are optimized for fast reads and writes, and they support ACID transactions.
Question:- What is dataframe in azure databricks?
Answer:- A dataframe is a type of table that stores data in the Databricks runtime. Dataframes are optimized for fast reads and writes, and they support ACID transactions.
Question:- What is the purpose of Kafka in Azure Databricks?
Answer:- Kafka is used in Azure Databricks for streaming data. It can be used to ingest data from sources such as sensors, logs, and financial transactions. Kafka can also be used to process and analyze streaming data in real-time.
Question:- What are the poetic devices in the poem "The Dust Of Snow"
Answer:- Literary devices used in Dust of Snow by Robert Frost
Rhyme Scheme
Alliteration
Rhyme Scheme:
Rhyme Scheme is the pattern of rhyming lines in a stanza or throughout the poem.
The Rhyme scheme in the "Dust of Snow" is
"The way a crow -a
Shook down on me -b
The dust of snow -a
From a hemlock tree -b "
Rhyme Scheme: abab
Alliteration:
Alliteration is the repetition of same consonant sound in the nearby words
Alliteration spoted in the "Dust of Snow"
Has given my heart
And saved some part
Alliterative words: Has, Heart; Saved Some
Question:- Two army persons A and B each of weight of 500 N climb up a rope through a height of 10 m. A takes 20 s while B takes 40 s to achieve this task. What is ratio of the powers of person A and B?
Answer:- The ratio of powers of A and B = 2: 1
Explanation :
Power = \frac{W}{t} = \frac{F.S}{t}
Where , Fa = 500N S = 10m
Fb = 500N ta = 20s , tb = 40s
Pa = \frac{Fa.S}{ta} = \frac{500 \times 10}{20} = 250 watts
Pa = \frac{Fa.S}{tb} = \frac{500 \times 10}{40} = 125 watts
\frac{Pa}{Pb} = \frac{250}{125} = \frac{2}{1} = 2 : 1
Question:- How do economists measure inflation? What is the major cause of inflation?
Answer:- Economists use a basket of goods that are geenrally used by the household in the market and they check the increase in the price of those goods, for example if the average price of basket increase by 10% over a year, then the inflation in the market has increased by 10%.
there are two majkor causes of infliton in the market they are:
Demand pull inflaiton, if the demand for the goods in the market increase a lot then the cost of the goods increase and that lead to an inflation Cost push inflation, if the price of the input goods increase in the market then the price of the goods increase and that leads to a higher price and inflation in the market.
there are two majkor causes of infliton in the market they are:
Demand pull inflaiton, if the demand for the goods in the market increase a lot then the cost of the goods increase and that lead to an inflation Cost push inflation, if the price of the input goods increase in the market then the price of the goods increase and that leads to a higher price and inflation in the market.
Question:- Can you force the caching of data without having to force it with a count? i.e is there some parameter you can use?
Answer:- count() is just an example of an action. Spark is lazy and will not execute your command until you trigger an action. .It is not good practice to force data in to memory that can quickly make to run out of memory.
Question:- Do you always store the results of an action into another variable?
Answer:- Nope, depends what you want to do with it. Actions can be things like "write it to disk", which wouldn't be a variable
