Some hints on Dataproc
When running a job in the cluster of Dataproc, it reported:
java.util.concurrent.ExecutionException: java.lang.ClassNotFoundException: Failed to find data source: BIGQUERY.
The reason is I havenR
...
ROBIN DONG 2021-09-03 11:54 | 查看: 1730
Kubeflow deployment: part 2
Instead of using other strange components of Kubeflow, we can just use Kubeflow Pipelines which is much easier to be deployed and used.
After deployment (less than 20 minutes), I test my first examp
...
ROBIN DONG 2021-08-20 14:55 | 查看: 461
My summary for the paper “Unified Language Model Pre-training for Natural Language Understanding and Generation”
For NLU (Natural Language Understanding), we use the bidirectional language model (like BERT), but for NLG(Natural Language Generation), the left-to-right unidirectional language model (like GPT) is t
...
ROBIN DONG 2021-08-10 08:56 | 查看: 457
Kubeflow deployment: part 1
By following the document, I tried to deploy the management cluster of Kubeflow. But after running make apply-cluster it reported:
The management cluster name "kubeflow-mgmt" is valid.
# De
...
ROBIN DONG 2021-07-30 08:02 | 查看: 633
Some tips in groovy of Jenkins
Groovy could be used as the configuration file for Jenkins workflow. Although I totally don’t make head or tail of Groovy, its syntax is not hard to learn.
How to iterate a list
To export a bu
...
ROBIN DONG 2021-07-23 08:23 | 查看: 433
How to paste in Vim
After I have written the SQL on BigQuery’s UI:
SELECT
first_column
FROM
`project.dataset.table`
ORDER BY
`first_column` ASC
LIMIT
1000
I tried to copy it to my Vim editor through ̶
...
ROBIN DONG 2021-07-16 09:29 | 查看: 443
The “real size” of hex file for AVR microcontroller
Recently I dug out my USBasp tool and a few AVR microcontrollers, for enjoying programming the C language again. Unexpectedly, the old ATTINY2313V and ATmega88V couldn’t work with my USBasp tool
...
ROBIN DONG 2021-07-08 18:35 | 查看: 365
First experiments about Vertex AI of Google Cloud
As the above menu show in the Vertex AI, it is trying to include all common processes of building and running a machine learning model.
For my experiment, I just create a Dataset by loading file from
...
ROBIN DONG 2021-06-25 09:56 | 查看: 507
The low-power mode for STM8L and ATTINY2313
I used to think STM8L would cost less energy than ATTINY. Today I got some time to view the datasheet for these two MCU.
First comes the STM8L datasheet:
If we just use low speed oscillator (LSI) in
...
ROBIN DONG 2021-06-18 14:52 | 查看: 361
Upgrade GKE cluster
Normally, to upgrade a cluster of Google Kubernetes Engine, we need to upgrade the master at first, and then node_pools. For convenience, I just click the button “UPGRADE AVAILABLE” in the
...
ROBIN DONG 2021-06-11 08:15 | 查看: 460
Recover truncated table in BigQuery
If you accidentally truncate a table in BigQuery, you can try this article to recover the data. Furthermore, I found out that the "bq cp project:dataset.table@-36000 project:dataset.table” metho
...
ROBIN DONG 2021-06-03 14:39 | 查看: 458
Be careful with random generate number
This is the program I have used for a month:
import numpy as np
np.random.seed(202105)
rand = np.random.rand()
# business logic code using 'rand'
Then I add another np.random.rand() in the head of
...
ROBIN DONG 2021-05-27 13:50 | 查看: 356